-- Logs begin at Tue 2022-06-21 17:14:15 UTC, end at Tue 2022-06-21 18:57:09 UTC. -- Jun 21 18:18:39.685838 dv-cinder-844601-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 18:18:39.700609 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 18:18:39.703480 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 18:18:39 2022] *** Jun 21 18:18:39.703480 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 18:18:39.703480 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 18:18:39.703480 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: nodename: dv-cinder-844601-4-iscsi Jun 21 18:18:39.703480 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: machine: x86_64 Jun 21 18:18:39.703480 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: clock source: unix Jun 21 18:18:39.703480 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: pcre jit disabled Jun 21 18:18:39.703480 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: detected number of CPU cores: 4 Jun 21 18:18:39.703480 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: current working directory: / Jun 21 18:18:39.703480 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: detected binary path: /usr/bin/uwsgi-core Jun 21 18:18:39.703480 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: your processes number limit is 47680 Jun 21 18:18:39.703480 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: your memory page size is 4096 bytes Jun 21 18:18:39.703480 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: detected max file descriptor number: 2048 Jun 21 18:18:39.703480 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: lock engine: pthread robust mutexes Jun 21 18:18:39.706141 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: thunder lock: enabled Jun 21 18:18:39.706141 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 18:18:39.706141 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 18:18:39.754760 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: Python main interpreter initialized at 0x55e0a49329c0 Jun 21 18:18:39.754760 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: python threads support enabled Jun 21 18:18:39.754760 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: your server socket listen backlog is limited to 100 connections Jun 21 18:18:39.754760 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: your mercy for graceful operations on workers is 90 seconds Jun 21 18:18:39.755510 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 18:18:39.755510 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: *** Operational MODE: preforking *** Jun 21 18:18:39.755832 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: *** uWSGI is running in multiple interpreter mode *** Jun 21 18:18:39.755832 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: spawned uWSGI master process (pid: 103455) Jun 21 18:18:39.755937 dv-cinder-844601-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 18:18:39.758088 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: spawned uWSGI worker 1 (pid: 103456, cores: 1) Jun 21 18:18:39.758088 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: spawned uWSGI worker 2 (pid: 103457, cores: 1) Jun 21 18:18:39.758088 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 18:18:40.576255 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 18:18:40.603654 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 18:18:42.577131 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:18:42.577131 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: from cryptography.utils import int_from_bytes Jun 21 18:18:42.577915 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:18:42.577915 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: from cryptography.utils import int_from_bytes Jun 21 18:18:42.666299 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:18:42.666299 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: from cryptography.utils import int_from_bytes Jun 21 18:18:42.666986 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:18:42.666986 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: from cryptography.utils import int_from_bytes Jun 21 18:18:46.526634 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 18:18:46.527902 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 18:18:46.527902 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 18:18:46.527902 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 18:18:46.528628 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 18:18:46.528628 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.528926 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.529175 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.529377 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 18:18:46.529877 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.529954 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 18:18:46.530079 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.530184 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.530265 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 18:18:46.530467 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.530568 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 18:18:46.530781 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 18:18:46.530937 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.531112 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.531203 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.531379 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.531504 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.531707 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.531887 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.532027 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844601-4-iscsi {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.532161 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.532441 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.532603 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.532772 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.532929 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.533085 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.533249 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.533573 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.533770 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.533920 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.533920 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.534271 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.534440 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.534605 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.534761 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844601-4-iscsi {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.535748 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.536057 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.536057 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.536520 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.536742 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.536962 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.537188 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.537407 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.537902 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.538237 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.538468 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.538688 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.538890 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.539153 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.539153 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.539501 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.539673 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.539824 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.539973 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.540117 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.540271 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.540422 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.540422 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.540677 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844601-4-iscsi {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.540828 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.541030 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.541229 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.541443 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.541588 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.541783 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.541954 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.542095 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.542306 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.542511 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.542714 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.542870 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.543674 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844601-4-iscsi {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.543943 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.544117 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.544458 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.544665 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.544820 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.544974 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.545124 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.545277 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.545425 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.545563 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.545750 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.545914 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.546067 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.546203 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.546355 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.546505 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.546645 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.546788 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.546946 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.546946 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.547205 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.547353 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.547353 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.547626 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.547784 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.547925 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.548068 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.548220 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.548372 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.548531 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.548683 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.548800 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.549060 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.549277 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.549492 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.549492 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.549799 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.549799 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.550058 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.550200 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.550200 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.550489 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.550634 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.550781 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.550930 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.551068 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.551224 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.551365 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.551505 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.551660 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.551818 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.551955 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.552110 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.552250 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.552401 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.552542 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.552759 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.552929 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.553084 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.553233 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.553374 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.553514 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.553719 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.553892 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.554041 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.554182 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.554318 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.554466 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.554599 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.554599 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.554936 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.87 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.554936 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.87 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.555152 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.555265 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.555427 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.555427 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.555690 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.555837 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.555988 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.556131 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.556286 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.556440 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.556606 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.556606 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.556886 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.87 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.556886 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.87 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.557167 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.557308 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.557459 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.557459 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.557795 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.557795 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.558086 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.558200 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.558284 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.558416 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.558501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.558501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.559449 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.559634 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.559787 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.559938 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.560081 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.560081 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.560353 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.560353 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.560625 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.560768 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.560919 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.561079 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.561240 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.561240 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.561498 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.561677 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.561832 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.561985 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.562137 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.562137 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.562411 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.562551 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.562551 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.562838 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.563033 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.563181 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.563318 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.563453 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.563604 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.563742 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.563887 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.564038 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.564175 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.564329 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.564481 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.564622 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.564766 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.564891 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.565029 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.565163 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.565504 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.565754 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.565918 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.566068 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.566207 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.566354 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.566567 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.566710 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.566862 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.567000 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.567198 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.567341 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.567494 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.567633 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.567786 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.568009 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.568184 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.568328 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.568489 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.568643 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.568783 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.568922 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.569073 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.569213 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.569424 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.569617 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.569825 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.569969 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.570108 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.570262 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.570411 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.570549 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.570688 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.570834 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.570973 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.571129 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.571276 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.571433 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.571564 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.571697 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.571890 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.572053 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.572200 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.572352 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.572496 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.572701 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.572859 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.573012 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.573204 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.573352 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.573493 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.573619 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.573809 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.573963 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.574112 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.574427 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.574584 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.574725 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.574725 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.575031 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.575180 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.575386 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.575548 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.575700 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.575856 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.575998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.576158 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.576293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.576438 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.576581 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.576725 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.576725 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.576981 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.577111 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:18:46.577253 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.577375 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.577508 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.577508 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.577789 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.577924 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.577924 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.578225 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.578366 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.578509 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.578651 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.578788 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.578939 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.579092 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.579238 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.579386 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.579524 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.579649 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.579785 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.579993 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.580172 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.580319 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.580472 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.580651 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.580816 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.580971 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.581114 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.581273 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.581415 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.581557 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.581720 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.581886 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.582037 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.582177 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.582341 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.582480 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.582616 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.582764 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.582906 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.583029 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.583158 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.583277 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.583408 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.583523 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.583523 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.583737 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.583857 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.583998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.584137 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.584273 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.584273 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.584538 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.584538 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.584781 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.584914 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.585050 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.585191 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.585314 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.585437 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.585569 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.585895 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.586041 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.586041 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.586305 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.586451 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.586596 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.586730 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.586852 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.586987 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.587127 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.587287 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.587425 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.587565 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.587708 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.587852 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.588006 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.588136 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.588299 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.588448 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.588592 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.588592 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.588873 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.588873 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.589170 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.589323 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.589464 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.589603 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.589940 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.590169 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.590358 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.590537 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.590682 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.590824 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.590961 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.591116 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.591246 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.591389 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.591517 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.591643 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.591643 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.591877 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.592011 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.592150 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.592289 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.592442 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.592566 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.592725 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.592880 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.593024 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.593179 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.593322 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.593474 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.593474 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.593742 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.593895 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.594033 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.594033 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.594311 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.594311 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.594581 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.594581 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.594848 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.594997 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.595147 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.595296 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.595435 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.595578 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.595702 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.595826 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.595983 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.596126 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.596287 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.596431 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.596572 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.596714 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.596878 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.597031 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.597185 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.597330 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.597472 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.597626 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.597880 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.598042 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.598184 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.598325 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.598465 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.598619 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.598762 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.598922 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.599064 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.599205 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.599350 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.599505 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.599660 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.599808 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.599931 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.600052 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.600189 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.600329 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.600525 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.600674 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.600820 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.600974 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.601133 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.601287 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.601431 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.601574 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.601739 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.601885 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.602045 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.602186 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.602329 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.602468 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.602607 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.602731 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.602885 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.603027 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.603181 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.603323 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.603477 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.603642 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.603767 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.603892 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.604022 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.604170 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.604296 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.604435 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.604609 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.604759 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.604913 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.605049 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.605195 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.605353 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.605717 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.605946 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.606195 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.606606 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.606827 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.606827 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.607259 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.607466 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.607741 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.607888 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.608025 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.608311 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.608461 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.608669 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.608874 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.609101 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.609315 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.609521 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.609754 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.609972 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.610213 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.610417 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.610635 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.610834 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.611032 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.611244 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.611454 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.611655 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.611879 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.612082 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.612286 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.612493 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.612699 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.612903 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.613123 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.613322 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.613538 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.613873 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.614094 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.614316 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.614522 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.614722 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.614918 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.615126 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.615334 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.615334 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.615737 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.615945 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.616189 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.616396 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.616603 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.616954 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.617163 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.617367 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.617578 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.617813 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.618367 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.618589 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.618803 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.618803 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.619198 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.619198 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.619596 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.619827 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.620050 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.620203 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.620405 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.620632 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.620800 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.621022 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.621201 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.621350 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.621490 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.621621 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.621824 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.622078 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.622287 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.622527 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.622739 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.622950 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.623185 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.623410 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.623639 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.623839 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.623988 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.624225 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.624447 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.624654 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.624850 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.625084 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.625292 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.625509 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.625743 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.625946 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.626146 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.626381 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.626589 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.626812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.627023 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.627023 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.627406 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.628019 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.628253 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.628462 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.628683 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.628889 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.629097 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.629097 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.629547 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.629790 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.629992 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.629992 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.630399 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.630604 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.630752 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.630904 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.631096 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.631246 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.631410 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.631554 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.631695 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.631832 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.631969 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.632163 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.632318 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.632456 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.632591 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.632716 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.632834 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.633033 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.633201 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.633338 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.633539 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.633818 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.633960 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.634110 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.634233 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.634356 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.634504 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.634656 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.634843 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.634991 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.635136 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.635284 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.635441 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.635591 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.635743 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.635901 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.636041 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.636179 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.636328 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.636526 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.636683 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.636900 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.637051 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.637190 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.637332 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.637557 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.637745 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.637889 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.638029 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.638231 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.638429 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.638587 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.638747 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.638893 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.639019 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.639159 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.639286 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.639492 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.639642 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.639780 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.639919 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.640056 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.640198 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.640339 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.640496 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.640635 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.640755 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.640873 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.641135 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.641294 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.641294 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.641549 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.641780 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.641951 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.642106 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.642319 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.642468 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.642619 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.642773 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.642916 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.643069 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.643222 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.643222 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.643486 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.643627 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.643780 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.643930 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.644075 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.644231 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.644426 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.644583 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.644583 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.644841 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.644983 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.645142 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.645292 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.645433 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.645573 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.645734 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.645875 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.646032 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.646171 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.646314 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.646468 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.646611 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.646899 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.647045 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.647189 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.647331 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.647489 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.647489 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.647765 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.647930 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.648082 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.648219 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.648364 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.648520 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.648665 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.648887 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.649035 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.649178 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.649326 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.649461 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.649595 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.649820 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.650079 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.650218 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.650362 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.650362 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.650614 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.650761 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.650895 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.651018 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.651146 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.651268 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.651414 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.651548 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.651682 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.651829 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.651971 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.652112 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.652272 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.652516 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.652669 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.652812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.652956 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.653077 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.653208 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.653338 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.653468 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.653620 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.653806 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.653933 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.654086 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.654226 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.654366 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.654509 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.654634 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.654770 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.654914 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.655054 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.655207 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.655347 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.655489 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.655642 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.655782 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.655922 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.656056 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.656195 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.656333 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.656489 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.656635 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.656774 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.656900 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.657029 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.657156 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.657318 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.657476 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.657476 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.657816 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.657962 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.658121 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.658237 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.658351 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.658458 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.658574 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.658713 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.658866 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.658993 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.659136 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.659292 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.659432 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.659572 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.659726 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.659860 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.659999 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.660143 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.660287 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.660431 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.660585 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.660731 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.660876 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.661013 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.661143 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.661345 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.661503 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.661683 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.661824 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.661966 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.662085 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.662248 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.662371 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.662511 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.662649 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.662784 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.662906 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.663037 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.663174 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.663292 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.663409 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.663409 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.663671 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.663671 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.663948 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.664089 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.664227 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.664371 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.664526 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.664682 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.664815 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.664940 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.665053 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.665168 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.665308 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.665448 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.665577 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.665733 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.665886 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.666035 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.666183 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.666301 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.666434 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.666567 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.666685 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.666685 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.666936 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.667062 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.667188 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.667332 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.667460 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.667631 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.667779 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.667907 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.668102 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.668233 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.668465 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.668623 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.668747 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.668890 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.669044 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.669188 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.669333 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.669480 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.669480 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.669816 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.669960 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.670088 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.670215 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.670365 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.670365 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.670601 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.670730 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.670861 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.670861 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.671223 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.671223 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.671470 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.671608 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.671733 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.671872 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.671872 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.672102 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.672230 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.672377 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.672524 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.672693 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.672693 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.672953 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.673095 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.673241 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.673385 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.673540 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.673706 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.673849 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.673991 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.674129 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.674291 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.674455 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.674602 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.674744 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.674872 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.674872 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.675123 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.675263 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.675396 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.675529 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.675659 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.675788 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.675937 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.676089 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.676228 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.676362 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.676621 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.676769 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.676931 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.677071 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.677204 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.677317 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.677442 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.677576 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.677846 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.677990 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.678132 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.678257 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.678382 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.678528 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.678668 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.678821 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.678947 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.679097 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.679239 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.679390 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.679531 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.679669 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.679795 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.679913 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.680031 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.680298 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.680444 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.680568 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.680704 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.680845 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.680993 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.681156 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.681156 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.681418 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.681556 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.681710 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.681855 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.682012 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.682139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.682260 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.682410 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.682570 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.682713 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.682867 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.683010 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.683152 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.683281 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.683405 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.683541 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.683541 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.683769 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.683769 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.684017 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.684173 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.684314 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.684454 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.684595 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.684750 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.684895 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.685035 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.685035 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.685254 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.685387 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.685387 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.685662 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.685829 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.685973 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.686131 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.686264 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.686411 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.686551 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.686708 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.686850 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.686988 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.687128 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.687391 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.687523 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.687681 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.687823 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.687965 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.688106 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.688252 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.688418 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.688562 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.688743 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.688893 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.689045 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.689194 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.689360 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.689519 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.689814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.689986 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.690132 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.690274 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.690434 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.690598 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.690729 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.690871 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.691023 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.691236 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.691402 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.691547 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.691673 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.691891 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.692215 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.692450 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.692712 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.692923 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.693124 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.693352 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.693552 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.693768 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.693964 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.694171 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.694381 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.694598 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.694809 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.695014 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.695207 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.695355 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.695543 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.695748 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.695969 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.696188 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.696400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.696620 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.696837 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.697046 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.697254 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.697466 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.697800 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.698019 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.698204 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.698403 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.698598 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.698815 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.699045 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.699287 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.699558 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.699720 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.699864 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.700000 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.700125 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.700257 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.700447 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.700582 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.700726 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.700878 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.701048 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.701048 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.701312 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.701456 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.701597 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.701799 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.701955 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.702085 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.702085 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.702330 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.702478 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.702478 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.702758 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.702897 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.702897 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.703175 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.703318 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.703533 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.703681 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.703825 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.703825 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.704085 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.704223 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.704364 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.704491 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.704628 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.704755 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.704898 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.705024 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.705157 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.705281 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.705416 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.705555 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.705693 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.705824 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.705948 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.706080 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.706220 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.706361 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.706361 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.706632 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.706767 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.706874 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.707005 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.707120 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.707247 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.707378 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.707540 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.707682 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.707848 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.707980 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.708230 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.708442 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.708637 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.708829 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.709014 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.709210 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.709412 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.709611 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.709834 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.710043 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.710176 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.710355 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.710617 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.710829 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.710959 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.711211 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.711395 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.711581 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.711581 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.711948 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.712079 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.712193 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.712397 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.712596 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.712801 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.713009 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.713230 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.713431 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.713569 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.713872 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.714076 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.714262 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.714466 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.714657 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.714963 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.715167 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.715167 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.715475 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.715475 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.715894 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.716083 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.716379 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.716569 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.716756 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.716756 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.717119 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.717119 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.717515 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.717750 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.717750 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.718194 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.718429 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.718649 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.718864 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.718864 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.719268 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.719479 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.719689 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.720019 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.720233 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.720395 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.720606 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.720808 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.721028 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.721244 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.721444 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.721444 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.721840 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.722026 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.722212 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.722444 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.722634 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.722823 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.723010 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.723195 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.723399 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.723624 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.723753 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.723864 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.724059 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.724240 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.724438 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.724626 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.724815 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.725013 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.725214 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.725414 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.725625 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.725804 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.725951 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.726182 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.726399 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.726615 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.726615 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.726998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.727204 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.727428 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.727428 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.727829 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.728056 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.728273 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.728426 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.728576 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.728720 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.728996 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.729133 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.729255 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.729393 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.729520 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.729723 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.729925 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.730058 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.730186 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.730314 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.730439 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.730439 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.730739 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.730846 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.730966 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.731096 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.731221 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.731429 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.731563 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.731563 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.731801 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.731980 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.732186 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.732318 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.732442 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.732556 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.732669 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.732781 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.732904 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.733014 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.733149 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.733425 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.733560 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.733744 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.733877 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.734052 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.734248 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.734381 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.734381 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.734619 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.734619 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.734878 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.735011 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.735142 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.735269 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.735412 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.735543 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.735670 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.735799 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.735926 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.736075 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.736199 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.736314 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.736314 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.736529 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.736640 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.736640 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.736887 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.737003 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.737124 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.737238 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.737375 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.737526 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.737679 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.737809 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.737936 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.738066 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.738208 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.738334 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.738636 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.738843 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.739056 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.739248 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.739465 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.739663 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.739793 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.739986 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.740174 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.740377 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.740377 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.740739 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.740946 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.741172 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.741419 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.741419 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.742073 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.742277 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.742480 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.742692 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.742692 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.743444 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.743609 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.743609 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.743998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.744143 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.744143 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.744557 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.744766 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.744975 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.745179 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.745334 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.745604 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.745862 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.746074 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.746267 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.746401 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.746524 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.746645 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.746782 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.747150 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.747364 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.747364 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.747749 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.747971 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.747971 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.748359 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.748581 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.748786 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.748994 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.749196 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.749375 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.749577 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.749734 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.749927 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.750150 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.750353 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.750537 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.750720 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.750903 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.751213 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.751486 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.751690 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.752042 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.752234 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.752437 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.752624 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.752822 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.753009 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.753009 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.753402 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.753607 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.753919 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.754134 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.754326 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.754550 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.754734 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.754929 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.755120 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.755120 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.755483 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.755668 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.755854 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.755854 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.756208 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.756357 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.756594 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.756797 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.757011 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.757228 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.757444 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.757701 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.757906 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.758111 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.758316 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.758521 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.758781 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.758996 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.759202 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.759410 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.759610 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.759810 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.760038 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.760256 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.760475 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.760683 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.760683 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.760683 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.761205 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.761391 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.761588 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.761780 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.762068 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.762270 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.762574 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.762713 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.762984 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.763216 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.763413 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.763631 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.763873 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.764099 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.764311 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.764508 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.764508 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.764824 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.765016 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.765150 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.765279 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.765279 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.765528 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.765696 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.765880 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.766028 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.766142 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.766328 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.766479 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.766612 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.766612 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.766843 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.766966 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.766966 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.767321 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.767460 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.767648 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.767791 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.767905 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.768025 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.768170 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.768286 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.768417 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.768556 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.768691 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.768830 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.768943 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.769149 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.769293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.769430 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.769556 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.769750 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.769891 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.770031 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.770167 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.770365 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.770511 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.770731 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.770880 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.771023 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.771182 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.771335 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.771481 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.771637 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.771637 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.771901 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.772044 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.772185 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.772346 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.772490 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.772632 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.772774 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.772928 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.773084 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.773222 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.773348 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.773479 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.773604 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.773845 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.773978 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.774175 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.774310 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.774439 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.774568 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.774758 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.774911 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.775050 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.775189 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.775327 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.775460 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.775596 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.775736 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.775863 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.776002 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.776139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.776281 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.776411 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.776538 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.776723 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.776864 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.776991 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.776991 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.777304 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.777550 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.777915 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.778074 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.778204 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.778329 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.778470 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.778586 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.778769 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.778896 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.779009 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.779130 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.779276 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.779404 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.779587 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.779717 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.779846 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.779984 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.780096 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.780096 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.780329 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.780452 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.780561 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.780753 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.780894 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.780894 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.781145 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.781285 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.781417 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.781553 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.781776 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.781907 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.782034 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.782159 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.782304 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.782304 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.782562 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.782695 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.782823 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.782953 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.782953 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.783220 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.783350 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.783478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.783606 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.783721 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.783905 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.784048 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.784179 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.784350 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.784530 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.784666 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.784810 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.784977 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.785112 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.785266 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.785411 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.785553 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.785553 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.785925 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.786064 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.786186 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.786186 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.786527 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.786527 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.786772 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.786915 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.787066 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.787208 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.787361 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.787488 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.787706 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.787855 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.788000 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.788142 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.788301 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.788446 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.788589 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.788791 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.788951 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.789103 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.789240 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.789436 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.789582 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.789734 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.789885 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.790133 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.790263 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.790390 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.790520 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.790633 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.790760 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.790902 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.790902 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.791124 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.791259 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.791383 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.791512 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.791647 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.791779 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.791906 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.792115 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.792256 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.792475 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.792611 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.792808 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.792945 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.793219 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.793349 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.793703 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.793938 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.793938 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.794331 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.794475 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.794590 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.794789 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.794979 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.795197 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.795389 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.795587 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.795587 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.795974 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.796165 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.796364 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.796558 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.796747 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.796747 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.797150 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.797357 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.797559 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.797849 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.797991 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.798154 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.798297 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.798434 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.798579 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.798720 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.798860 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.799036 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.799182 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.799320 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.799449 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.799591 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.799730 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.799931 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.800078 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.800220 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.800363 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 18:18:46.800571 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.800571 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:18:46.800571 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 18:18:46.872380 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO dbcounter [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] Registered counter for database nova_api Jun 21 18:18:46.973767 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO dbcounter [None req-30fdacc7-b204-4a44-a8db-bc73628c063d None None] Registered counter for database nova_api Jun 21 18:18:46.997705 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_db.sqlalchemy.engines [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:18:46.998205 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG oslo_db.sqlalchemy.engines [None req-30fdacc7-b204-4a44-a8db-bc73628c063d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:18:47.005888 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writer thread running {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:18:47.007590 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writer thread running {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:18:47.071734 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.context [None req-30fdacc7-b204-4a44-a8db-bc73628c063d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1ae3aa00-a91e-47d9-9392-29a47002ac79(cell1) {{(pid=103457) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 18:18:47.076349 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG oslo_concurrency.lockutils [None req-30fdacc7-b204-4a44-a8db-bc73628c063d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:18:47.078041 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG oslo_concurrency.lockutils [None req-30fdacc7-b204-4a44-a8db-bc73628c063d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:18:47.078874 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG oslo_concurrency.lockutils [None req-30fdacc7-b204-4a44-a8db-bc73628c063d None None] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:18:47.080920 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG oslo_concurrency.lockutils [None req-30fdacc7-b204-4a44-a8db-bc73628c063d None None] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:18:47.083146 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO dbcounter [None req-30fdacc7-b204-4a44-a8db-bc73628c063d None None] Registered counter for database nova_cell0 Jun 21 18:18:47.087741 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO dbcounter [None req-30fdacc7-b204-4a44-a8db-bc73628c063d None None] Registered counter for database nova_cell1 Jun 21 18:18:47.096931 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG oslo_db.sqlalchemy.engines [None req-30fdacc7-b204-4a44-a8db-bc73628c063d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:18:47.098519 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG oslo_db.sqlalchemy.engines [None req-30fdacc7-b204-4a44-a8db-bc73628c063d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:18:47.105714 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writer thread running {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:18:47.107837 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writer thread running {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:18:47.123743 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.context [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1ae3aa00-a91e-47d9-9392-29a47002ac79(cell1) {{(pid=103456) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 18:18:47.131540 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:18:47.134895 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:18:47.136366 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:18:47.140739 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:18:47.144844 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO dbcounter [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] Registered counter for database nova_cell0 Jun 21 18:18:47.152739 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO dbcounter [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] Registered counter for database nova_cell1 Jun 21 18:18:47.166475 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_db.sqlalchemy.engines [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:18:47.169547 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_db.sqlalchemy.engines [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:18:47.175168 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writer thread running {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:18:47.177836 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writer thread running {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:18:47.269871 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO dbcounter [None req-30fdacc7-b204-4a44-a8db-bc73628c063d None None] Registered counter for database nova_cell0 Jun 21 18:18:47.283767 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG oslo_db.sqlalchemy.engines [None req-30fdacc7-b204-4a44-a8db-bc73628c063d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:18:47.290046 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writer thread running {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:18:47.338300 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO dbcounter [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] Registered counter for database nova_cell0 Jun 21 18:18:47.347931 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_db.sqlalchemy.engines [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:18:47.352989 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writer thread running {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:18:47.688113 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: WARNING keystonemiddleware.auth_token [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:18:47.696138 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: WARNING keystonemiddleware.auth_token [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:18:47.918253 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: WARNING keystonemiddleware.auth_token [None req-30fdacc7-b204-4a44-a8db-bc73628c063d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:18:47.931579 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: WARNING keystonemiddleware.auth_token [None req-30fdacc7-b204-4a44-a8db-bc73628c063d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:18:48.050606 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: WARNING keystonemiddleware.auth_token [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:18:48.057092 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: WARNING keystonemiddleware.auth_token [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:18:48.063249 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x55e0a49329c0 pid: 103456 (default app) Jun 21 18:18:48.065490 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:18:48.066721 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] 10.222.0.87 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001919 Jun 21 18:18:48.067156 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 1/1] 10.222.0.87 () {50 vars in 788 bytes} [Tue Jun 21 18:18:48 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:18:48.364338 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: WARNING keystonemiddleware.auth_token [None req-30fdacc7-b204-4a44-a8db-bc73628c063d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:18:48.371534 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: WARNING keystonemiddleware.auth_token [None req-30fdacc7-b204-4a44-a8db-bc73628c063d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:18:48.377163 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x55e0a49329c0 pid: 103457 (default app) Jun 21 18:20:27.288675 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:27.289754 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jun 21 18:20:27.290166 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 2/2] 10.222.0.87 () {54 vars in 930 bytes} [Tue Jun 21 18:20:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:20:27.307172 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writing DB stats nova_api:SELECT=3 {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:20:27.308541 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writing DB stats nova_cell0:SELECT=3 {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:20:27.309506 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writing DB stats nova_cell1:SELECT=3 {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:20:27.310632 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:20:27.904411 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-a4462d11-82d1-4abd-bb50-d1bf23e657e1 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:27.943586 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-a4462d11-82d1-4abd-bb50-d1bf23e657e1 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.642141 Jun 21 18:20:27.945831 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 1/3] 10.222.0.87 () {60 vars in 1291 bytes} [Tue Jun 21 18:20:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:20:30.564073 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:30.566640 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-e0b0df7b-61dc-4a23-989b-1c7ad4988c6a None None] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003045 Jun 21 18:20:30.567682 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 3/4] 10.222.0.87 () {54 vars in 930 bytes} [Tue Jun 21 18:20:30 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:20:30.646621 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-d14568a5-7246-4677-aa98-ac51e22d62c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "disk": 1}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:30.665559 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:20:30.665559 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: warnings.warn(msg) Jun 21 18:20:30.714144 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-d14568a5-7246-4677-aa98-ac51e22d62c7 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.138710 Jun 21 18:20:30.715265 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 2/5] 10.222.0.87 () {64 vars in 1282 bytes} [Tue Jun 21 18:20:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 18:20:30.729881 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_api:SELECT=3 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:20:30.731120 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_cell1:SELECT=3 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:20:30.732781 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_cell0:SELECT=3 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:20:30.733623 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_cell0:SELECT=3 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:20:30.964693 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-0848031f-b2fa-4baa-97ed-ffa88a0842ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:30.968108 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:20:30.968108 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: warnings.warn(msg) Jun 21 18:20:31.051355 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-0848031f-b2fa-4baa-97ed-ffa88a0842ef admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.327029 Jun 21 18:20:31.052611 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 4/6] 10.222.0.87 () {64 vars in 1335 bytes} [Tue Jun 21 18:20:30 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:20:33.726774 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-d14568a5-7246-4677-aa98-ac51e22d62c7 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:33.728811 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-d14568a5-7246-4677-aa98-ac51e22d62c7 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002596 Jun 21 18:20:33.729563 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 3/7] 10.222.0.87 () {54 vars in 930 bytes} [Tue Jun 21 18:20:33 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:20:33.931517 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-7bb306b4-e00a-4f2a-891e-9bbbb36c0fa0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "os-flavor-access:is_public": true, "swap": 0, "id": "d1", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:33.966180 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:20:33.966180 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: warnings.warn(msg) Jun 21 18:20:33.998209 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-7bb306b4-e00a-4f2a-891e-9bbbb36c0fa0 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.256665 Jun 21 18:20:33.999111 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 5/8] 10.222.0.87 () {64 vars in 1282 bytes} [Tue Jun 21 18:20:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:20:34.018930 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-e207466c-56af-41e5-8f66-23de17122927 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:34.021931 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:20:34.021931 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: warnings.warn(msg) Jun 21 18:20:34.084731 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-e207466c-56af-41e5-8f66-23de17122927 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.072238 Jun 21 18:20:34.085974 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 4/9] 10.222.0.87 () {64 vars in 1335 bytes} [Tue Jun 21 18:20:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:20:36.785880 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-7bb306b4-e00a-4f2a-891e-9bbbb36c0fa0 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:36.788226 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-7bb306b4-e00a-4f2a-891e-9bbbb36c0fa0 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003088 Jun 21 18:20:36.789441 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 6/10] 10.222.0.87 () {54 vars in 930 bytes} [Tue Jun 21 18:20:36 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:20:36.882159 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-3698e647-e407-40e5-b9ea-fe4882949cdc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "ram": 1024, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G", "vcpus": 1}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:36.916543 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-3698e647-e407-40e5-b9ea-fe4882949cdc admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.117685 Jun 21 18:20:36.917365 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 5/11] 10.222.0.87 () {64 vars in 1282 bytes} [Tue Jun 21 18:20:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 18:20:36.934543 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-cb51aa55-544e-45cf-bae7-c3c7a7016835 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:36.976236 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-cb51aa55-544e-45cf-bae7-c3c7a7016835 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049458 Jun 21 18:20:36.986259 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 7/12] 10.222.0.87 () {64 vars in 1335 bytes} [Tue Jun 21 18:20:36 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:20:39.476477 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-3698e647-e407-40e5-b9ea-fe4882949cdc admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:39.479488 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-3698e647-e407-40e5-b9ea-fe4882949cdc admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003569 Jun 21 18:20:39.480360 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 6/13] 10.222.0.87 () {54 vars in 930 bytes} [Tue Jun 21 18:20:39 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:20:39.655182 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-5ca6ad06-f00b-4d0b-8628-6bce49d25d8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "id": "d3", "ram": 2048}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:39.702162 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-5ca6ad06-f00b-4d0b-8628-6bce49d25d8d admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.210162 Jun 21 18:20:39.715395 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 8/14] 10.222.0.87 () {64 vars in 1282 bytes} [Tue Jun 21 18:20:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:20:39.733388 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-5ec32178-9c65-4b3d-856e-11a29e534725 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:39.811289 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-5ec32178-9c65-4b3d-856e-11a29e534725 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090142 Jun 21 18:20:39.831302 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 7/15] 10.222.0.87 () {64 vars in 1335 bytes} [Tue Jun 21 18:20:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:20:42.207856 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-5ca6ad06-f00b-4d0b-8628-6bce49d25d8d admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:42.208996 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-5ca6ad06-f00b-4d0b-8628-6bce49d25d8d admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jun 21 18:20:42.209425 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 9/16] 10.222.0.87 () {54 vars in 930 bytes} [Tue Jun 21 18:20:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:20:42.287330 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-2300a406-e470-44aa-9e7b-c59cc304abb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 20}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:42.310816 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-2300a406-e470-44aa-9e7b-c59cc304abb9 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.093549 Jun 21 18:20:42.311414 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 8/17] 10.222.0.87 () {64 vars in 1282 bytes} [Tue Jun 21 18:20:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:20:42.330203 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-0509c954-a5f2-47aa-8dbb-351d41766ff8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:42.372998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-0509c954-a5f2-47aa-8dbb-351d41766ff8 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048604 Jun 21 18:20:42.373938 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 10/18] 10.222.0.87 () {64 vars in 1335 bytes} [Tue Jun 21 18:20:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:20:44.909798 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-2300a406-e470-44aa-9e7b-c59cc304abb9 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:44.910828 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-2300a406-e470-44aa-9e7b-c59cc304abb9 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Jun 21 18:20:44.911467 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 9/19] 10.222.0.87 () {54 vars in 930 bytes} [Tue Jun 21 18:20:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:20:44.988609 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-a20f54c5-0438-438c-a31a-96f86ab08d2c admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:45.016374 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-a20f54c5-0438-438c-a31a-96f86ab08d2c admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.097701 Jun 21 18:20:45.016947 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 11/20] 10.222.0.87 () {60 vars in 1291 bytes} [Tue Jun 21 18:20:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:20:48.003075 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-2300a406-e470-44aa-9e7b-c59cc304abb9 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:48.004418 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-2300a406-e470-44aa-9e7b-c59cc304abb9 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001734 Jun 21 18:20:48.005229 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 10/21] 10.222.0.87 () {54 vars in 930 bytes} [Tue Jun 21 18:20:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:20:48.123029 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-24eae760-c710-4714-a557-b1673d19557f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1", "vcpus": 1, "name": "m1.tiny", "ram": 512, "disk": 1, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:48.155377 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-24eae760-c710-4714-a557-b1673d19557f admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.137588 Jun 21 18:20:48.156770 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 12/22] 10.222.0.87 () {64 vars in 1282 bytes} [Tue Jun 21 18:20:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:20:48.177086 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-21c46948-328e-4e4c-8eac-4f739dab20b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:48.221521 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-21c46948-328e-4e4c-8eac-4f739dab20b3 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051031 Jun 21 18:20:48.241678 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 11/23] 10.222.0.87 () {64 vars in 1332 bytes} [Tue Jun 21 18:20:48 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:20:50.780177 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-24eae760-c710-4714-a557-b1673d19557f admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:50.781321 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-24eae760-c710-4714-a557-b1673d19557f admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001686 Jun 21 18:20:50.781827 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 13/24] 10.222.0.87 () {54 vars in 930 bytes} [Tue Jun 21 18:20:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:20:50.881192 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-d5c07347-6348-49a0-a4f9-96f136d701a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "name": "m1.small", "vcpus": 1, "id": "2", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:50.919722 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-d5c07347-6348-49a0-a4f9-96f136d701a6 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.130241 Jun 21 18:20:50.921008 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 12/25] 10.222.0.87 () {64 vars in 1282 bytes} [Tue Jun 21 18:20:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:20:50.939529 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-8cb13b78-194c-47ee-be79-298322c987dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:50.986662 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-8cb13b78-194c-47ee-be79-298322c987dd admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052378 Jun 21 18:20:50.987988 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 14/26] 10.222.0.87 () {64 vars in 1332 bytes} [Tue Jun 21 18:20:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:20:53.761909 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-d5c07347-6348-49a0-a4f9-96f136d701a6 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:53.763299 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-d5c07347-6348-49a0-a4f9-96f136d701a6 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001865 Jun 21 18:20:53.764240 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 13/27] 10.222.0.87 () {54 vars in 930 bytes} [Tue Jun 21 18:20:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:20:53.863714 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-0a2ba15a-8240-4eb4-a1e8-14aa4d6dff7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "3", "ram": 4096, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:53.890259 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-0a2ba15a-8240-4eb4-a1e8-14aa4d6dff7d admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.117773 Jun 21 18:20:53.891022 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 15/28] 10.222.0.87 () {64 vars in 1282 bytes} [Tue Jun 21 18:20:53 2022] POST /compute/v2.1/flavors => generated 406 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 18:20:53.907144 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-e4c68476-cd8b-40ff-863e-3c54478f34af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:53.949867 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-e4c68476-cd8b-40ff-863e-3c54478f34af admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047466 Jun 21 18:20:53.950787 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 14/29] 10.222.0.87 () {64 vars in 1332 bytes} [Tue Jun 21 18:20:53 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:20:56.718597 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-0a2ba15a-8240-4eb4-a1e8-14aa4d6dff7d admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:56.720094 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-0a2ba15a-8240-4eb4-a1e8-14aa4d6dff7d admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002217 Jun 21 18:20:56.720706 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 16/30] 10.222.0.87 () {54 vars in 930 bytes} [Tue Jun 21 18:20:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:20:56.794095 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-ab3d35cb-2617-491a-9394-2ce189fddad5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true, "ram": 8192, "name": "m1.large", "vcpus": 4, "swap": 0}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:56.815294 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-ab3d35cb-2617-491a-9394-2ce189fddad5 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.086250 Jun 21 18:20:56.816305 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 15/31] 10.222.0.87 () {64 vars in 1282 bytes} [Tue Jun 21 18:20:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:20:56.833149 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-46256578-4c73-4f3a-872f-943d478bb0fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:56.873399 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-46256578-4c73-4f3a-872f-943d478bb0fe admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047301 Jun 21 18:20:56.874590 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 17/32] 10.222.0.87 () {64 vars in 1332 bytes} [Tue Jun 21 18:20:56 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:20:59.366476 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-ab3d35cb-2617-491a-9394-2ce189fddad5 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:20:59.368885 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-ab3d35cb-2617-491a-9394-2ce189fddad5 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002480 Jun 21 18:20:59.369589 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 16/33] 10.222.0.87 () {54 vars in 930 bytes} [Tue Jun 21 18:20:59 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:20:59.456459 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-07513ed5-70b1-4c5c-b13b-18e5ac1e31ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5"}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:59.484243 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-07513ed5-70b1-4c5c-b13b-18e5ac1e31ea admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.103916 Jun 21 18:20:59.485325 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 18/34] 10.222.0.87 () {64 vars in 1282 bytes} [Tue Jun 21 18:20:59 2022] POST /compute/v2.1/flavors => generated 408 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 18:20:59.504066 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-9c081eb3-7aab-49bf-b75f-d6011e3b49f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:20:59.510765 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:20:59.584553 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-9c081eb3-7aab-49bf-b75f-d6011e3b49f4 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086137 Jun 21 18:20:59.586093 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 17/35] 10.222.0.87 () {64 vars in 1332 bytes} [Tue Jun 21 18:20:59 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:21:30.294460 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-07513ed5-70b1-4c5c-b13b-18e5ac1e31ea admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:30.296316 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-07513ed5-70b1-4c5c-b13b-18e5ac1e31ea admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002616 Jun 21 18:21:30.297059 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 19/36] 10.222.0.87 () {54 vars in 930 bytes} [Tue Jun 21 18:21:30 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:21:30.376116 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-8fe48118-94b7-4a4b-b302-90f3b7340686 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:30.410759 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-8fe48118-94b7-4a4b-b302-90f3b7340686 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.102540 Jun 21 18:21:30.411769 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 18/37] 10.222.0.87 () {60 vars in 1291 bytes} [Tue Jun 21 18:21:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:21:31.467452 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-07513ed5-70b1-4c5c-b13b-18e5ac1e31ea admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:31.469255 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-07513ed5-70b1-4c5c-b13b-18e5ac1e31ea admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002232 Jun 21 18:21:31.469954 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 20/38] 10.222.0.87 () {56 vars in 1074 bytes} [Tue Jun 21 18:21:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:21:31.672173 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-df85a06a-fd9c-467f-851d-396c470d1a07 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:31.679261 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.wsgi [None req-df85a06a-fd9c-467f-851d-396c470d1a07 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-df85a06a-fd9c-467f-851d-396c470d1a07 admin admin] Request method failure captured: Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Accept: application/json Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Accept-Encoding: gzip, deflate Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Connection: keep-alive Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Content-Length: 0 Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Host: 10.222.0.87 Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Openstack-Api-Version: compute 2.90 Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Openstack-System-Scope: None Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: User-Agent: python-novaclient Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Auth-Token: gAAAAABisgwrzn-PRrJRW0CRmKWHahkvqlzxcF8NB8-ORncyN4sg9unZ8Le-_B2fnklOURTcT6G6VoUl5ljXQLiBRqpeq-J56mAPY1uk-PXtYXcn4zFQMlq9K3oqXRl13TRwXS0IOjNvfWVMcJMjb7ipWd4C5iDyPcwcbpcAKcmoWEFaV5a0rEM Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Domain-Id: None Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Domain-Name: None Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Identity-Status: Confirmed Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Is-Admin-Project: True Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Project-Domain-Id: default Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Project-Domain-Name: Default Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Project-Id: 58da051d3b4a47fab4c706fb517e9ae8 Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Project-Name: admin Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Role: reader,admin,member Jun 21 18:21:31.683735 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Roles: reader,admin,member Jun 21 18:21:31.685242 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:21:31.685242 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Tenant: admin Jun 21 18:21:31.685242 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Tenant-Id: 58da051d3b4a47fab4c706fb517e9ae8 Jun 21 18:21:31.685242 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Tenant-Name: admin Jun 21 18:21:31.685242 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-User: admin Jun 21 18:21:31.685242 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-User-Domain-Id: default Jun 21 18:21:31.685242 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-User-Domain-Name: Default Jun 21 18:21:31.685242 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-User-Id: dd94cb8910014827bad3f45b205880f7 Jun 21 18:21:31.685242 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-User-Name: admin Jun 21 18:21:31.685242 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: method: > Jun 21 18:21:31.685242 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: exception: Flavor 42 could not be found. Jun 21 18:21:31.685242 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: action_args: {'id': '42'} Jun 21 18:21:31.685242 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:21:31.685242 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:21:31.686139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 18:21:31.686139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 18:21:31.686139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 18:21:31.686139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 18:21:31.686139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:21:31.686139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:21:31.686139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 18:21:31.686139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 18:21:31.686139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 18:21:31.686139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:21:31.686139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 18:21:31.686139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 18:21:31.686139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 18:21:31.686139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jun 21 18:21:31.686139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:21:31.686139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jun 21 18:21:31.686139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:21:31.686139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:21:31.686139 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:21:31.687476 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:21:31.687476 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:21:31.687476 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:21:31.687476 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:21:31.687476 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 18:21:31.687476 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:21:31.687476 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 18:21:31.687476 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jun 21 18:21:31.687476 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:21:31.687476 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jun 21 18:21:31.687476 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:21:31.687476 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:21:31.687476 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:21:31.687476 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:21:31.687476 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:21:31.687476 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 18:21:31.687476 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jun 21 18:21:31.687476 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-df85a06a-fd9c-467f-851d-396c470d1a07 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:21:31.689089 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-df85a06a-fd9c-467f-851d-396c470d1a07 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.073091 Jun 21 18:21:31.689089 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 19/39] 10.222.0.87 () {60 vars in 1190 bytes} [Tue Jun 21 18:21:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 18:21:31.698943 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-af10e40f-42a9-43a6-9ec5-71a1a5865fd1 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:31.702168 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:21:31.723530 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-af10e40f-42a9-43a6-9ec5-71a1a5865fd1 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028467 Jun 21 18:21:31.724133 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 21/40] 10.222.0.87 () {60 vars in 1210 bytes} [Tue Jun 21 18:21:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:21:31.736891 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-02b6c717-70d7-432e-b90d-5ec332a024a9 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:31.763886 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-02b6c717-70d7-432e-b90d-5ec332a024a9 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030717 Jun 21 18:21:31.764462 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 20/41] 10.222.0.87 () {60 vars in 1210 bytes} [Tue Jun 21 18:21:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:21:31.774673 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-c1caf837-6188-4a04-99c3-868b82ac3192 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:31.782159 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.wsgi [None req-c1caf837-6188-4a04-99c3-868b82ac3192 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-c1caf837-6188-4a04-99c3-868b82ac3192 admin admin] Request method failure captured: Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Accept: application/json Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Accept-Encoding: gzip, deflate Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Connection: keep-alive Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Content-Length: 0 Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Host: 10.222.0.87 Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Openstack-Api-Version: compute 2.90 Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Openstack-System-Scope: None Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: User-Agent: python-novaclient Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Auth-Token: gAAAAABisgwrzn-PRrJRW0CRmKWHahkvqlzxcF8NB8-ORncyN4sg9unZ8Le-_B2fnklOURTcT6G6VoUl5ljXQLiBRqpeq-J56mAPY1uk-PXtYXcn4zFQMlq9K3oqXRl13TRwXS0IOjNvfWVMcJMjb7ipWd4C5iDyPcwcbpcAKcmoWEFaV5a0rEM Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Domain-Id: None Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Domain-Name: None Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Identity-Status: Confirmed Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Is-Admin-Project: True Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Project-Domain-Id: default Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Project-Domain-Name: Default Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Project-Id: 58da051d3b4a47fab4c706fb517e9ae8 Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Project-Name: admin Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Role: reader,admin,member Jun 21 18:21:31.785501 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Roles: reader,admin,member Jun 21 18:21:31.788180 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:21:31.788180 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Tenant: admin Jun 21 18:21:31.788180 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Tenant-Id: 58da051d3b4a47fab4c706fb517e9ae8 Jun 21 18:21:31.788180 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Tenant-Name: admin Jun 21 18:21:31.788180 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-User: admin Jun 21 18:21:31.788180 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-User-Domain-Id: default Jun 21 18:21:31.788180 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-User-Domain-Name: Default Jun 21 18:21:31.788180 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-User-Id: dd94cb8910014827bad3f45b205880f7 Jun 21 18:21:31.788180 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-User-Name: admin Jun 21 18:21:31.788180 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: method: > Jun 21 18:21:31.788180 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: exception: Flavor 42 could not be found. Jun 21 18:21:31.788180 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: action_args: {'id': '42'} Jun 21 18:21:31.788180 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:21:31.788180 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:21:31.789998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 18:21:31.789998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 18:21:31.789998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 18:21:31.789998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 18:21:31.789998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:21:31.789998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:21:31.789998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 18:21:31.789998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 18:21:31.789998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 18:21:31.789998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:21:31.789998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 18:21:31.789998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 18:21:31.789998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 18:21:31.789998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jun 21 18:21:31.789998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:21:31.789998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jun 21 18:21:31.789998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:21:31.789998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:21:31.789998 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:21:31.791654 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:21:31.791654 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:21:31.791654 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:21:31.791654 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:21:31.791654 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 18:21:31.791654 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:21:31.791654 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 18:21:31.791654 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jun 21 18:21:31.791654 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:21:31.791654 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jun 21 18:21:31.791654 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:21:31.791654 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:21:31.791654 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:21:31.791654 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:21:31.791654 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:21:31.791654 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 18:21:31.791654 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jun 21 18:21:31.791654 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-c1caf837-6188-4a04-99c3-868b82ac3192 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:21:31.793405 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-c1caf837-6188-4a04-99c3-868b82ac3192 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016262 Jun 21 18:21:31.793405 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 22/42] 10.222.0.87 () {60 vars in 1190 bytes} [Tue Jun 21 18:21:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 18:21:32.801467 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-02b6c717-70d7-432e-b90d-5ec332a024a9 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:32.802752 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-02b6c717-70d7-432e-b90d-5ec332a024a9 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001683 Jun 21 18:21:32.803217 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 21/43] 10.222.0.87 () {56 vars in 1074 bytes} [Tue Jun 21 18:21:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:21:33.063302 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-6adcf6a2-ae53-4b72-8a21-68843b67b4b1 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:33.073290 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.wsgi [None req-6adcf6a2-ae53-4b72-8a21-68843b67b4b1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-6adcf6a2-ae53-4b72-8a21-68843b67b4b1 admin admin] Request method failure captured: Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Accept: application/json Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Accept-Encoding: gzip, deflate Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Connection: keep-alive Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Content-Length: 0 Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Host: 10.222.0.87 Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Openstack-Api-Version: compute 2.90 Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Openstack-System-Scope: None Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: User-Agent: python-novaclient Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Auth-Token: gAAAAABisgwsYegWhlTR0YulOG6AhER_ZLamRiFPTwGdywekUFL4QNCpsbhWmovmyzOgW0EZGIseCe-XUOV6Rl8LW3qk4O49NwxrpWKIuvGj6WFfGE-8oxDV9J5fIMxDgylfY2ZZcgTYXcuSG0R335s4XtwVk6vcLApS5vrJMw7V76zAoB7Aibg Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Domain-Id: None Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Domain-Name: None Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Identity-Status: Confirmed Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Is-Admin-Project: True Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Project-Domain-Id: default Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Project-Domain-Name: Default Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Project-Id: 58da051d3b4a47fab4c706fb517e9ae8 Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Project-Name: admin Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Role: reader,admin,member Jun 21 18:21:33.076293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Roles: reader,admin,member Jun 21 18:21:33.078210 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:21:33.078210 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Tenant: admin Jun 21 18:21:33.078210 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Tenant-Id: 58da051d3b4a47fab4c706fb517e9ae8 Jun 21 18:21:33.078210 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Tenant-Name: admin Jun 21 18:21:33.078210 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-User: admin Jun 21 18:21:33.078210 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-User-Domain-Id: default Jun 21 18:21:33.078210 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-User-Domain-Name: Default Jun 21 18:21:33.078210 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-User-Id: dd94cb8910014827bad3f45b205880f7 Jun 21 18:21:33.078210 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-User-Name: admin Jun 21 18:21:33.078210 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: method: > Jun 21 18:21:33.078210 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: exception: Flavor 84 could not be found. Jun 21 18:21:33.078210 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: action_args: {'id': '84'} Jun 21 18:21:33.078210 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:21:33.078210 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:21:33.079270 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 18:21:33.079270 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 18:21:33.079270 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 18:21:33.079270 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 18:21:33.079270 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:21:33.079270 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:21:33.079270 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 18:21:33.079270 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 18:21:33.079270 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 18:21:33.079270 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:21:33.079270 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 18:21:33.079270 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 18:21:33.079270 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 18:21:33.079270 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jun 21 18:21:33.079270 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:21:33.079270 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jun 21 18:21:33.079270 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:21:33.079270 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:21:33.079270 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:21:33.080649 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:21:33.080649 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:21:33.080649 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:21:33.080649 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:21:33.080649 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 18:21:33.080649 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:21:33.080649 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 18:21:33.080649 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jun 21 18:21:33.080649 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:21:33.080649 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jun 21 18:21:33.080649 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:21:33.080649 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:21:33.080649 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:21:33.080649 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:21:33.080649 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:21:33.080649 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 18:21:33.080649 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jun 21 18:21:33.080649 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-6adcf6a2-ae53-4b72-8a21-68843b67b4b1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:21:33.081972 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-6adcf6a2-ae53-4b72-8a21-68843b67b4b1 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.086199 Jun 21 18:21:33.081972 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 23/44] 10.222.0.87 () {60 vars in 1190 bytes} [Tue Jun 21 18:21:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 21 18:21:33.093703 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-a6ebf913-7840-465b-a59a-3fa565769c7e admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:33.110234 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-a6ebf913-7840-465b-a59a-3fa565769c7e admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020888 Jun 21 18:21:33.110868 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 22/45] 10.222.0.87 () {60 vars in 1210 bytes} [Tue Jun 21 18:21:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:21:33.125130 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-2297dc75-148b-4e6f-b31f-a7de9a7e0ed0 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:33.141685 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-2297dc75-148b-4e6f-b31f-a7de9a7e0ed0 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020700 Jun 21 18:21:33.142289 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 24/46] 10.222.0.87 () {60 vars in 1210 bytes} [Tue Jun 21 18:21:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:21:33.153198 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-08b189ac-b2bc-4e9b-b805-e1d23c343402 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:33.166406 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.wsgi [None req-08b189ac-b2bc-4e9b-b805-e1d23c343402 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-08b189ac-b2bc-4e9b-b805-e1d23c343402 admin admin] Request method failure captured: Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Accept: application/json Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Accept-Encoding: gzip, deflate Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Connection: keep-alive Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Content-Length: 0 Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Host: 10.222.0.87 Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Openstack-Api-Version: compute 2.90 Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Openstack-System-Scope: None Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: User-Agent: python-novaclient Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Auth-Token: gAAAAABisgwsYegWhlTR0YulOG6AhER_ZLamRiFPTwGdywekUFL4QNCpsbhWmovmyzOgW0EZGIseCe-XUOV6Rl8LW3qk4O49NwxrpWKIuvGj6WFfGE-8oxDV9J5fIMxDgylfY2ZZcgTYXcuSG0R335s4XtwVk6vcLApS5vrJMw7V76zAoB7Aibg Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Domain-Id: None Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Domain-Name: None Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Identity-Status: Confirmed Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Is-Admin-Project: True Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Project-Domain-Id: default Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Project-Domain-Name: Default Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Project-Id: 58da051d3b4a47fab4c706fb517e9ae8 Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Project-Name: admin Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Role: reader,admin,member Jun 21 18:21:33.169584 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Roles: reader,admin,member Jun 21 18:21:33.172058 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:21:33.172058 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Tenant: admin Jun 21 18:21:33.172058 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Tenant-Id: 58da051d3b4a47fab4c706fb517e9ae8 Jun 21 18:21:33.172058 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Tenant-Name: admin Jun 21 18:21:33.172058 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-User: admin Jun 21 18:21:33.172058 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-User-Domain-Id: default Jun 21 18:21:33.172058 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-User-Domain-Name: Default Jun 21 18:21:33.172058 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-User-Id: dd94cb8910014827bad3f45b205880f7 Jun 21 18:21:33.172058 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-User-Name: admin Jun 21 18:21:33.172058 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: method: > Jun 21 18:21:33.172058 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: exception: Flavor 84 could not be found. Jun 21 18:21:33.172058 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: action_args: {'id': '84'} Jun 21 18:21:33.172058 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:21:33.172058 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:21:33.173658 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 18:21:33.173658 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 18:21:33.173658 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 18:21:33.173658 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 18:21:33.173658 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:21:33.173658 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:21:33.173658 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 18:21:33.173658 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 18:21:33.173658 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 18:21:33.173658 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:21:33.173658 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 18:21:33.173658 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 18:21:33.173658 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 18:21:33.173658 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jun 21 18:21:33.173658 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:21:33.173658 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jun 21 18:21:33.173658 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:21:33.173658 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:21:33.173658 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:21:33.176221 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:21:33.176221 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:21:33.176221 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:21:33.176221 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:21:33.176221 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 18:21:33.176221 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:21:33.176221 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 18:21:33.176221 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jun 21 18:21:33.176221 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:21:33.176221 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jun 21 18:21:33.176221 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:21:33.176221 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:21:33.176221 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:21:33.176221 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:21:33.176221 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:21:33.176221 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 18:21:33.176221 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jun 21 18:21:33.176221 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-08b189ac-b2bc-4e9b-b805-e1d23c343402 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:21:33.178441 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-08b189ac-b2bc-4e9b-b805-e1d23c343402 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.022900 Jun 21 18:21:33.178441 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 23/47] 10.222.0.87 () {60 vars in 1190 bytes} [Tue Jun 21 18:21:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 21 18:21:34.107462 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-2297dc75-148b-4e6f-b31f-a7de9a7e0ed0 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:34.108629 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-2297dc75-148b-4e6f-b31f-a7de9a7e0ed0 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Jun 21 18:21:34.109154 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 25/48] 10.222.0.87 () {56 vars in 1074 bytes} [Tue Jun 21 18:21:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:21:34.339278 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-4290cf52-0013-4dd5-9571-0e745cae657d admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:34.345917 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.wsgi [None req-4290cf52-0013-4dd5-9571-0e745cae657d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-4290cf52-0013-4dd5-9571-0e745cae657d admin admin] Request method failure captured: Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Accept: application/json Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Accept-Encoding: gzip, deflate Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Connection: keep-alive Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Content-Length: 0 Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Host: 10.222.0.87 Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Openstack-Api-Version: compute 2.90 Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Openstack-System-Scope: None Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: User-Agent: python-novaclient Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Auth-Token: gAAAAABisgwuWecCKolNOTxPGrtakj_l4tmUSQqFYNCFoJi8sWoSm0jsbinpIlD_zG4dOKDlpTXtxsOyUpIsTqiXBJQQAc5CuHz8VDYlJJhVJ7T5ztUje5OgUMZEFCrHAHga_Ie3kIugFAkTgOOqCmXu0wkXrOM00Sr4pBCvmsjt7GKt-Ev9UFQ Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Domain-Id: None Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Domain-Name: None Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Identity-Status: Confirmed Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Is-Admin-Project: True Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Project-Domain-Id: default Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Project-Domain-Name: Default Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Project-Id: 58da051d3b4a47fab4c706fb517e9ae8 Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Project-Name: admin Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Role: reader,admin,member Jun 21 18:21:34.347478 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Roles: reader,admin,member Jun 21 18:21:34.350662 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:21:34.350662 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Tenant: admin Jun 21 18:21:34.350662 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Tenant-Id: 58da051d3b4a47fab4c706fb517e9ae8 Jun 21 18:21:34.350662 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-Tenant-Name: admin Jun 21 18:21:34.350662 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-User: admin Jun 21 18:21:34.350662 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-User-Domain-Id: default Jun 21 18:21:34.350662 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-User-Domain-Name: Default Jun 21 18:21:34.350662 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-User-Id: dd94cb8910014827bad3f45b205880f7 Jun 21 18:21:34.350662 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: X-User-Name: admin Jun 21 18:21:34.350662 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: method: > Jun 21 18:21:34.350662 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: exception: Flavor 451 could not be found. Jun 21 18:21:34.350662 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: action_args: {'id': '451'} Jun 21 18:21:34.350662 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:21:34.350662 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:21:34.352812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 18:21:34.352812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 18:21:34.352812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 18:21:34.352812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 18:21:34.352812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:21:34.352812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:21:34.352812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 18:21:34.352812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 18:21:34.352812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 18:21:34.352812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:21:34.352812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 18:21:34.352812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 18:21:34.352812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 18:21:34.352812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jun 21 18:21:34.352812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:21:34.352812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jun 21 18:21:34.352812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:21:34.352812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:21:34.352812 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:21:34.355849 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:21:34.355849 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:21:34.355849 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:21:34.355849 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:21:34.355849 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 18:21:34.355849 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:21:34.355849 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 18:21:34.355849 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jun 21 18:21:34.355849 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:21:34.355849 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jun 21 18:21:34.355849 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:21:34.355849 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:21:34.355849 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:21:34.355849 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:21:34.355849 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:21:34.355849 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 18:21:34.355849 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jun 21 18:21:34.355849 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-4290cf52-0013-4dd5-9571-0e745cae657d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:21:34.358552 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-4290cf52-0013-4dd5-9571-0e745cae657d admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.095734 Jun 21 18:21:34.358552 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 24/49] 10.222.0.87 () {60 vars in 1193 bytes} [Tue Jun 21 18:21:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 18:21:34.367088 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-5d9bb1a3-be29-48ee-9dac-10b7fd854d68 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:34.384930 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-5d9bb1a3-be29-48ee-9dac-10b7fd854d68 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022438 Jun 21 18:21:34.385606 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 26/50] 10.222.0.87 () {60 vars in 1210 bytes} [Tue Jun 21 18:21:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:21:34.396464 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-afb22b56-5d1f-4c87-8b38-89b1893065f4 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:34.413448 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-afb22b56-5d1f-4c87-8b38-89b1893065f4 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020460 Jun 21 18:21:34.414251 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 25/51] 10.222.0.87 () {60 vars in 1210 bytes} [Tue Jun 21 18:21:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:21:34.429661 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-0d5bcee6-bc09-4f46-9054-6ac28a212dca admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:34.439398 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.wsgi [None req-0d5bcee6-bc09-4f46-9054-6ac28a212dca admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-0d5bcee6-bc09-4f46-9054-6ac28a212dca admin admin] Request method failure captured: Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Accept: application/json Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Accept-Encoding: gzip, deflate Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Connection: keep-alive Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Content-Length: 0 Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Host: 10.222.0.87 Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Openstack-Api-Version: compute 2.90 Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Openstack-System-Scope: None Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: User-Agent: python-novaclient Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Auth-Token: gAAAAABisgwuWecCKolNOTxPGrtakj_l4tmUSQqFYNCFoJi8sWoSm0jsbinpIlD_zG4dOKDlpTXtxsOyUpIsTqiXBJQQAc5CuHz8VDYlJJhVJ7T5ztUje5OgUMZEFCrHAHga_Ie3kIugFAkTgOOqCmXu0wkXrOM00Sr4pBCvmsjt7GKt-Ev9UFQ Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Domain-Id: None Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Domain-Name: None Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Identity-Status: Confirmed Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Is-Admin-Project: True Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Project-Domain-Id: default Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Project-Domain-Name: Default Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Project-Id: 58da051d3b4a47fab4c706fb517e9ae8 Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Project-Name: admin Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Role: reader,admin,member Jun 21 18:21:34.442400 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Roles: reader,admin,member Jun 21 18:21:34.443837 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_58da051d3b4a47fab4c706fb517e9ae8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:21:34.443837 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Tenant: admin Jun 21 18:21:34.443837 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Tenant-Id: 58da051d3b4a47fab4c706fb517e9ae8 Jun 21 18:21:34.443837 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-Tenant-Name: admin Jun 21 18:21:34.443837 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-User: admin Jun 21 18:21:34.443837 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-User-Domain-Id: default Jun 21 18:21:34.443837 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-User-Domain-Name: Default Jun 21 18:21:34.443837 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-User-Id: dd94cb8910014827bad3f45b205880f7 Jun 21 18:21:34.443837 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: X-User-Name: admin Jun 21 18:21:34.443837 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: method: > Jun 21 18:21:34.443837 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: exception: Flavor 451 could not be found. Jun 21 18:21:34.443837 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: action_args: {'id': '451'} Jun 21 18:21:34.443837 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:21:34.443837 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:21:34.444814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 18:21:34.444814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 18:21:34.444814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 18:21:34.444814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 18:21:34.444814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:21:34.444814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:21:34.444814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 18:21:34.444814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 18:21:34.444814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 18:21:34.444814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:21:34.444814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 18:21:34.444814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 18:21:34.444814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 18:21:34.444814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jun 21 18:21:34.444814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:21:34.444814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jun 21 18:21:34.444814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:21:34.444814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:21:34.444814 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:21:34.445978 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:21:34.445978 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:21:34.445978 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:21:34.445978 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:21:34.445978 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 18:21:34.445978 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:21:34.445978 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 18:21:34.445978 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jun 21 18:21:34.445978 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:21:34.445978 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jun 21 18:21:34.445978 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:21:34.445978 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:21:34.445978 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:21:34.445978 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:21:34.445978 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:21:34.445978 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 18:21:34.445978 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jun 21 18:21:34.445978 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-0d5bcee6-bc09-4f46-9054-6ac28a212dca admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:21:34.447208 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-0d5bcee6-bc09-4f46-9054-6ac28a212dca admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.023551 Jun 21 18:21:34.447208 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 27/52] 10.222.0.87 () {60 vars in 1193 bytes} [Tue Jun 21 18:21:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 18:21:35.570248 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-afb22b56-5d1f-4c87-8b38-89b1893065f4 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:35.571330 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-afb22b56-5d1f-4c87-8b38-89b1893065f4 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002297 Jun 21 18:21:35.571750 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 26/53] 10.222.0.87 () {56 vars in 1074 bytes} [Tue Jun 21 18:21:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:21:35.776445 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-38473d00-092f-4f03-930e-6ca2f146a0a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:21:35.798780 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-38473d00-092f-4f03-930e-6ca2f146a0a0 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.083834 Jun 21 18:21:35.799404 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 28/54] 10.222.0.87 () {64 vars in 1235 bytes} [Tue Jun 21 18:21:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:21:36.710520 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-afb22b56-5d1f-4c87-8b38-89b1893065f4 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:36.711518 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-afb22b56-5d1f-4c87-8b38-89b1893065f4 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001781 Jun 21 18:21:36.711928 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 27/55] 10.222.0.87 () {56 vars in 1074 bytes} [Tue Jun 21 18:21:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:21:36.919531 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-66e878a8-5431-42f8-9ccd-6add6c5a7836 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:21:36.942704 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-66e878a8-5431-42f8-9ccd-6add6c5a7836 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.087635 Jun 21 18:21:36.943564 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 29/56] 10.222.0.87 () {64 vars in 1235 bytes} [Tue Jun 21 18:21:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:21:37.924999 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-afb22b56-5d1f-4c87-8b38-89b1893065f4 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:37.926597 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-afb22b56-5d1f-4c87-8b38-89b1893065f4 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002255 Jun 21 18:21:37.927224 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 28/57] 10.222.0.87 () {56 vars in 1074 bytes} [Tue Jun 21 18:21:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:21:38.299128 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-19be52a6-b278-495d-b54f-22d0c3bdd66a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:21:38.336419 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-19be52a6-b278-495d-b54f-22d0c3bdd66a admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.122121 Jun 21 18:21:38.337290 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 30/58] 10.222.0.87 () {64 vars in 1235 bytes} [Tue Jun 21 18:21:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:21:39.358533 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-afb22b56-5d1f-4c87-8b38-89b1893065f4 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:39.359919 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-afb22b56-5d1f-4c87-8b38-89b1893065f4 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001961 Jun 21 18:21:39.360441 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 29/59] 10.222.0.87 () {56 vars in 1074 bytes} [Tue Jun 21 18:21:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:21:39.572417 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-c494382b-e18e-45ad-b293-c047a7d4fa39 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:21:39.602039 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-c494382b-e18e-45ad-b293-c047a7d4fa39 admin admin] 10.222.0.87 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.093174 Jun 21 18:21:39.603123 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 31/60] 10.222.0.87 () {64 vars in 1235 bytes} [Tue Jun 21 18:21:39 2022] POST /compute/v2.1/flavors => generated 409 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 18:21:40.536281 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-afb22b56-5d1f-4c87-8b38-89b1893065f4 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:40.537364 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-afb22b56-5d1f-4c87-8b38-89b1893065f4 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001791 Jun 21 18:21:40.538609 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 30/61] 10.222.0.87 () {56 vars in 1074 bytes} [Tue Jun 21 18:21:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:21:40.768726 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-d06c7353-3b99-459c-a818-de86768bd5c3 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:21:40.790805 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-d06c7353-3b99-459c-a818-de86768bd5c3 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.095080 Jun 21 18:21:40.791432 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 32/62] 10.222.0.87 () {60 vars in 1202 bytes} [Tue Jun 21 18:21:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:22:39.219143 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-afb22b56-5d1f-4c87-8b38-89b1893065f4 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:22:39.220890 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-afb22b56-5d1f-4c87-8b38-89b1893065f4 admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002297 Jun 21 18:22:39.221502 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 31/63] 10.222.0.87 () {54 vars in 930 bytes} [Tue Jun 21 18:22:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:22:39.234156 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:22:39.301528 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-11685924-cd9b-4782-b78f-5485580d3781 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:22:39.323286 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-11685924-cd9b-4782-b78f-5485580d3781 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.094128 Jun 21 18:22:39.323887 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 33/64] 10.222.0.87 () {60 vars in 1291 bytes} [Tue Jun 21 18:22:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:22:39.351370 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-c5b36a89-81b4-4de1-a082-e421fdddc7ec admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:22:39.355272 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:22:39.365076 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-c5b36a89-81b4-4de1-a082-e421fdddc7ec admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020098 Jun 21 18:22:39.365862 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 32/65] 10.222.0.87 () {60 vars in 1282 bytes} [Tue Jun 21 18:22:39 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:22:39.385051 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-030c3840-fe27-4cba-82d5-a1a277371db4 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:22:39.398011 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-030c3840-fe27-4cba-82d5-a1a277371db4 admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018733 Jun 21 18:22:39.398714 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 34/66] 10.222.0.87 () {60 vars in 1285 bytes} [Tue Jun 21 18:22:39 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:22:39.417361 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-02b7e511-79a0-45dc-ab2a-36118b96cf5f admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:22:39.429501 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-02b7e511-79a0-45dc-ab2a-36118b96cf5f admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017438 Jun 21 18:22:39.430293 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 33/67] 10.222.0.87 () {60 vars in 1285 bytes} [Tue Jun 21 18:22:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:22:39.445953 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-121a4f9d-ba73-4e8e-804f-f9a68d79cc9a admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:22:39.458215 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-121a4f9d-ba73-4e8e-804f-f9a68d79cc9a admin admin] 10.222.0.87 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016721 Jun 21 18:22:39.458808 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 35/68] 10.222.0.87 () {60 vars in 1282 bytes} [Tue Jun 21 18:22:39 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:26:45.300388 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-02b7e511-79a0-45dc-ab2a-36118b96cf5f admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:26:45.302442 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-02b7e511-79a0-45dc-ab2a-36118b96cf5f admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002540 Jun 21 18:26:45.303121 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 34/69] 10.222.0.87 () {56 vars in 1074 bytes} [Tue Jun 21 18:26:45 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:26:45.568069 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_api:SELECT=6 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:26:45.746513 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-d1bdeecb-1360-4957-9962-bd7b1b9c748c admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:26:45.748685 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:26:45.748685 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: warnings.warn(msg) Jun 21 18:26:45.751067 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-d1bdeecb-1360-4957-9962-bd7b1b9c748c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:26:45.751857 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-d1bdeecb-1360-4957-9962-bd7b1b9c748c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:26:45.753293 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-d1bdeecb-1360-4957-9962-bd7b1b9c748c admin admin] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:26:45.754238 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-d1bdeecb-1360-4957-9962-bd7b1b9c748c admin admin] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:26:45.801110 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-d1bdeecb-1360-4957-9962-bd7b1b9c748c admin admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.235354 Jun 21 18:26:45.801976 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 36/70] 10.222.0.87 () {60 vars in 1193 bytes} [Tue Jun 21 18:26:45 2022] GET /compute/v2.1/os-services => generated 791 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:26:46.868727 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-02b7e511-79a0-45dc-ab2a-36118b96cf5f admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:26:46.871102 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-02b7e511-79a0-45dc-ab2a-36118b96cf5f admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002593 Jun 21 18:26:46.871693 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 35/71] 10.222.0.87 () {56 vars in 1074 bytes} [Tue Jun 21 18:26:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:26:47.114843 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-9aee36f1-c2a5-4a78-977a-80af7629bbb5 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:26:47.115944 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:26:47.115944 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: warnings.warn(msg) Jun 21 18:26:47.117948 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-9aee36f1-c2a5-4a78-977a-80af7629bbb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:26:47.118750 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-9aee36f1-c2a5-4a78-977a-80af7629bbb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:26:47.119732 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-9aee36f1-c2a5-4a78-977a-80af7629bbb5 admin admin] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:26:47.120204 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-9aee36f1-c2a5-4a78-977a-80af7629bbb5 admin admin] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:26:47.142809 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-9aee36f1-c2a5-4a78-977a-80af7629bbb5 admin admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.093102 Jun 21 18:26:47.143499 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 37/72] 10.222.0.87 () {60 vars in 1193 bytes} [Tue Jun 21 18:26:47 2022] GET /compute/v2.1/os-services => generated 791 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:26:58.673258 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-02b7e511-79a0-45dc-ab2a-36118b96cf5f admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:26:58.675096 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-02b7e511-79a0-45dc-ab2a-36118b96cf5f admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002521 Jun 21 18:26:58.676177 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 36/73] 10.222.0.87 () {56 vars in 1074 bytes} [Tue Jun 21 18:26:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:26:58.855455 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_cell0:SELECT=4 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:26:58.857287 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_cell1:SELECT=4 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:26:58.857287 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_api:SELECT=8 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:26:58.937922 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-dfa2d7a3-05d5-4e27-81df-14820360c2d4 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:26:58.939256 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:26:58.939256 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: warnings.warn(msg) Jun 21 18:26:58.941180 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-dfa2d7a3-05d5-4e27-81df-14820360c2d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:26:58.942394 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-dfa2d7a3-05d5-4e27-81df-14820360c2d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:26:58.943235 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-dfa2d7a3-05d5-4e27-81df-14820360c2d4 admin admin] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:26:58.943928 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-dfa2d7a3-05d5-4e27-81df-14820360c2d4 admin admin] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:26:58.982619 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-dfa2d7a3-05d5-4e27-81df-14820360c2d4 admin admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.136431 Jun 21 18:26:58.983500 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 38/74] 10.222.0.87 () {60 vars in 1193 bytes} [Tue Jun 21 18:26:58 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:26:59.975879 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-02b7e511-79a0-45dc-ab2a-36118b96cf5f admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:26:59.976893 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-02b7e511-79a0-45dc-ab2a-36118b96cf5f admin admin] 10.222.0.87 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 21 18:26:59.977311 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 37/75] 10.222.0.87 () {56 vars in 1074 bytes} [Tue Jun 21 18:26:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:27:00.270816 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-3ae6fe47-3895-4b49-b228-9f87903ab850 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:27:00.271720 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 18:27:00.271720 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: warnings.warn(msg) Jun 21 18:27:00.273442 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-3ae6fe47-3895-4b49-b228-9f87903ab850 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:00.274084 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-3ae6fe47-3895-4b49-b228-9f87903ab850 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:00.275315 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-3ae6fe47-3895-4b49-b228-9f87903ab850 admin admin] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:27:00.275812 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-3ae6fe47-3895-4b49-b228-9f87903ab850 admin admin] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:27:00.313090 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-3ae6fe47-3895-4b49-b228-9f87903ab850 admin admin] 10.222.0.87 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.155042 Jun 21 18:27:00.314117 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 39/76] 10.222.0.87 () {60 vars in 1193 bytes} [Tue Jun 21 18:27:00 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:28:05.054769 dv-cinder-844601-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 21 18:28:05.056171 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: Tue Jun 21 18:28:05 2022 - graceful shutdown triggered... Jun 21 18:28:05.056891 dv-cinder-844601-4-iscsi devstack@n-api.service[103456]: Gracefully killing worker 1 (pid: 103456)... Jun 21 18:28:05.057518 dv-cinder-844601-4-iscsi devstack@n-api.service[103457]: Gracefully killing worker 2 (pid: 103457)... Jun 21 18:28:06.056942 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: worker 1 buried after 1 seconds Jun 21 18:28:06.057566 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: worker 2 buried after 1 seconds Jun 21 18:28:06.057566 dv-cinder-844601-4-iscsi devstack@n-api.service[103455]: goodbye to uWSGI. Jun 21 18:28:06.059276 dv-cinder-844601-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 21 18:28:06.060139 dv-cinder-844601-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 21 18:28:06.064710 dv-cinder-844601-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 18:28:06.084082 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 18:28:06.087106 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 18:28:06 2022] *** Jun 21 18:28:06.087106 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 18:28:06.087106 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 18:28:06.087106 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: nodename: dv-cinder-844601-4-iscsi Jun 21 18:28:06.087106 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: machine: x86_64 Jun 21 18:28:06.087106 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: clock source: unix Jun 21 18:28:06.087106 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: pcre jit disabled Jun 21 18:28:06.087106 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: detected number of CPU cores: 4 Jun 21 18:28:06.087106 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: current working directory: / Jun 21 18:28:06.087106 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: detected binary path: /usr/bin/uwsgi-core Jun 21 18:28:06.087106 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: your processes number limit is 47680 Jun 21 18:28:06.088525 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: your memory page size is 4096 bytes Jun 21 18:28:06.088525 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: detected max file descriptor number: 2048 Jun 21 18:28:06.088525 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: lock engine: pthread robust mutexes Jun 21 18:28:06.088525 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: thunder lock: enabled Jun 21 18:28:06.088525 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 18:28:06.088525 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 18:28:06.145531 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: Python main interpreter initialized at 0x55c91bd3e9c0 Jun 21 18:28:06.145531 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: python threads support enabled Jun 21 18:28:06.145531 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: your server socket listen backlog is limited to 100 connections Jun 21 18:28:06.145531 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: your mercy for graceful operations on workers is 90 seconds Jun 21 18:28:06.146264 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 18:28:06.146264 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: *** Operational MODE: preforking *** Jun 21 18:28:06.146698 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: *** uWSGI is running in multiple interpreter mode *** Jun 21 18:28:06.146698 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: spawned uWSGI master process (pid: 118090) Jun 21 18:28:06.146929 dv-cinder-844601-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 18:28:06.147974 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: spawned uWSGI worker 1 (pid: 118108, cores: 1) Jun 21 18:28:06.147974 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: spawned uWSGI worker 2 (pid: 118109, cores: 1) Jun 21 18:28:06.148300 dv-cinder-844601-4-iscsi devstack@n-api.service[118090]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 18:28:07.089143 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 18:28:07.280499 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 18:28:09.053986 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:28:09.053986 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: from cryptography.utils import int_from_bytes Jun 21 18:28:09.055110 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:28:09.055110 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: from cryptography.utils import int_from_bytes Jun 21 18:28:09.190192 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:28:09.190192 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: from cryptography.utils import int_from_bytes Jun 21 18:28:09.191383 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 18:28:09.191383 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: from cryptography.utils import int_from_bytes Jun 21 18:28:12.821444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 18:28:12.822489 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 18:28:12.822489 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 18:28:12.822752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 18:28:12.822904 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 18:28:12.823271 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.823603 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.823923 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.824239 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.824570 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.824878 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.825204 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.825521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.825878 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.826138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.826688 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.826824 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844601-4-iscsi {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.827084 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.827393 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.827704 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.828023 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.828326 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.828643 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.829114 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.829678 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.830744 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.831362 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.832157 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.832958 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.833523 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.834850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.835439 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.836015 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.836621 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.837177 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.838005 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844601-4-iscsi {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.838554 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.839817 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.840802 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.841726 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.842407 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.843064 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.843643 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.844076 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.844439 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.844854 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.845249 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.845717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.846078 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.846396 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.847008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.847188 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.848010 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.848906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.848906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.848906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.849347 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.849486 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.849834 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.850335 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.850761 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.851183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.851693 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.852026 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.852343 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.852654 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.852964 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.853413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.853585 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.854670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.855201 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.855741 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.856324 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.857251 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.857415 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.858014 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.858561 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.859281 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.87 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.859578 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.87 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.860431 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.861042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.861683 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.862288 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.862675 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.863268 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.863814 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.864348 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.864872 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.865470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.866232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.866769 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.867227 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.867839 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.868390 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.868988 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.870505 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.871080 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.871611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.872172 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.872717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.873776 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.873776 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.874192 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.874680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.875264 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.875806 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.876376 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.876929 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.877539 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.878201 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.878756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.879468 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.880466 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.880466 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.881345 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.881928 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.882486 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.883058 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.883611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.884151 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.884722 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.885252 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.885841 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.886407 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.886947 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.887485 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.888059 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.888605 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.889772 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.889772 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.890279 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.890822 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.891369 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.891911 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.892467 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.892846 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.893511 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.895472 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.895472 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.895472 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.895472 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.895472 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:12.896523 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.896523 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.896809 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.897205 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.897568 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.897963 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.898513 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.899043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.899587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.902077 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.903014 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.903572 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.904161 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.904723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.905371 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.906003 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.906792 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.907594 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.908381 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.909323 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.910303 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.912308 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.912308 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.912308 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.913057 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.913057 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.913821 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.914426 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.915617 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.915617 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.918134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.918134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.918134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.918134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.918134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.918756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.918756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.919134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.919794 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.920572 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.921235 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.921986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.922571 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.923078 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.923539 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.924007 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.924460 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.926080 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.926080 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.926463 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.926741 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.927183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.927961 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.928104 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.928516 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.928997 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.929455 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.930010 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.930481 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.930931 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.931384 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.931843 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.932283 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.932734 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.933181 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.933688 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.934164 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.934659 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.935597 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.935761 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.936196 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.936746 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.938521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.938521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.938521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.939010 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.939451 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.940021 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.941062 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.941263 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.941753 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.942318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.942845 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.943660 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.944418 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.945282 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.946053 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.946802 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.947364 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.947918 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.948496 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.949028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.949561 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.950131 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.950676 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.951210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.951748 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.952331 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.952872 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.953415 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.954200 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.955225 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.955786 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.956594 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.957225 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.958835 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.959026 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.959572 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.960100 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.960767 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.961196 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.961795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.962303 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.962958 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.963504 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.964042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.964768 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.965154 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.965946 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.966343 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.966938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.967463 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.968421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.968768 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.969458 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.970551 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.971134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.971750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.973125 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.976456 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.976456 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.976456 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.976456 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.976456 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.977501 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.977729 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.979002 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.979002 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.979427 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.980010 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.980989 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.981573 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.982325 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.982772 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.983645 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.983813 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.984339 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.985344 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.985818 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.986391 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.986941 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.987911 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.988109 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.989774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.989774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.990576 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.991152 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.991726 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.992250 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.992935 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.993285 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.994870 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.994870 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.995207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.995491 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.996124 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.997380 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.997555 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.998295 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:12.999975 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.000285 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.000773 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.001309 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.001944 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.002483 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.003165 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.003682 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.004996 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.004996 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.005487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.006060 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.006592 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.007186 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.009179 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.009179 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.009179 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.010606 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.010606 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.010606 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.011468 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.011468 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.011917 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.012557 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.013419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.014058 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.014654 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.015702 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.016446 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.018527 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.018527 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.018527 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.020266 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.020266 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.021305 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.021305 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.021837 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.022270 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.022995 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.023631 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.024204 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.024886 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.025578 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.026162 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.027763 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.028370 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.028957 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.029741 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.030556 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.031349 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.031920 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.032452 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.033252 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.033940 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.035280 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.035280 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.035879 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.036434 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.037067 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.037773 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.038292 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.038875 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.040429 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.040429 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.040839 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.041052 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.041933 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.042637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.043194 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.045221 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.045221 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.045221 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.045897 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.046180 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.046750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.047892 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.047892 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.048438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.049001 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.049586 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.050890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.051120 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.051488 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.052047 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.052780 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.053192 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.053992 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.054426 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.056110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.056110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.056502 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.057072 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.057589 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.058824 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.059359 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.059930 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.060474 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.061008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.061540 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.062116 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.062675 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.063153 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.063671 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.064221 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.065104 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.066492 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.066492 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.067987 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.067987 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.067987 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.068502 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.069051 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.069582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.070803 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.071369 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.071901 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.072564 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.073692 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.073692 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.074224 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.074683 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.075317 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.076056 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.076685 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.077212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.077866 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.078416 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.079023 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.079558 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.080119 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.080625 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.081243 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.082361 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.082361 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.082876 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.083395 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.083957 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.084514 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.085065 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.085911 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.086462 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.087722 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.087722 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.088079 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.088628 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.089172 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.089764 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.090305 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.090830 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.091629 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.092181 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.093005 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.093275 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.093856 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.094386 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.094894 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.095420 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.096197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.096813 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.098073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.098073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.098470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.099002 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.099758 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.100766 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.101300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.102485 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.103029 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.104241 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.104241 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.104698 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.105833 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.105833 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.106724 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.107611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.107766 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.108314 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.108841 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.109565 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.110430 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.110936 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.112258 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.112258 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.113730 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.113730 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.113730 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.115086 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.115086 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.116883 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.116883 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.116883 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.117316 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.117830 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.118638 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.119414 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.120451 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.120451 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.121002 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.121540 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.122154 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.122698 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.123260 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.123810 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.124354 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.124922 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.125508 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.126130 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.126639 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.127449 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.127929 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.128464 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.129509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.129746 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.130196 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.130718 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.132041 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.132041 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.132413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.132972 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.133542 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.134020 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.134571 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.135100 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.135785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.136135 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.136696 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.137255 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.138846 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.141702 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.141702 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.141702 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.141702 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.141702 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.142449 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.142629 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.143397 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.143729 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.144514 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.144877 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.145440 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.146107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.146648 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.147174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.147763 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.148344 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.148882 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.149440 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.150034 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.150574 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.151115 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.151664 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.152199 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.152710 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.153455 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.153800 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.154328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.154851 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.155380 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.155936 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.156462 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.157017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.157543 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.158106 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.158630 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.159219 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.159823 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.160345 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.161678 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.161678 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.162041 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.162574 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.164732 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.164732 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.164732 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.164732 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.165664 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.165845 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.166382 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.166932 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.167518 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.168024 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.168877 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.169160 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.170422 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.170675 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.171239 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.171786 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.172343 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.172888 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.173442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.180636 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.180636 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.180636 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.180636 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.180636 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.180636 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.180636 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.180636 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.181942 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.181942 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.181942 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.181942 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.181942 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.181942 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.181942 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.182933 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.182933 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.183545 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.184091 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.184547 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.185077 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.185700 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.186336 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.188314 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.188314 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.188314 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.188716 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.188964 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.192285 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.192285 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.192285 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.192285 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.192285 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.193060 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.193725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.194412 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.194983 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.195600 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.196113 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.197017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.197307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.197847 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.198383 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.198932 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.199491 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.200031 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.200599 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.201163 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.202287 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.202792 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.203349 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.204362 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.204971 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.205548 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.206185 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.207997 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.207997 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.207997 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.208500 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.209018 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.209615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.210406 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.210981 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.211746 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.212323 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.213192 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.214818 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.215056 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.215611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.216145 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.216719 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.217265 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.217841 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.218384 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.218945 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.219502 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.220224 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.220599 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.221067 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.221703 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.222262 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.222896 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.223586 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.224106 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.224662 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.226526 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.226526 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.226852 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.227276 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.227814 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.228361 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.228922 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.230060 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.230835 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.231316 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.231822 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.232387 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.233309 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.233918 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.234412 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.235274 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.235766 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.236229 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.236683 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.237559 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.238261 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.239177 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.239352 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.240397 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.240397 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.240919 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.241422 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.242073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.242495 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.243426 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.243731 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.244954 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.244954 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.245452 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.245764 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.246352 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.246834 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.247308 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.247782 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.248252 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.248833 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.249299 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.249846 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.250425 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.250836 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.251330 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.251795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.252251 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.253689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.253689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.254806 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.254806 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.255210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.255668 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.256210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.256873 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.257411 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.258142 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.258742 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.259323 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.260003 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.260524 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.261025 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.262110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.262371 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.262860 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.263352 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.263888 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.264608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.265088 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.265694 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.266279 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.266834 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.267578 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.269386 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.270155 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.272159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.272159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.272159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.272159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.272159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.272588 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.272786 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.273731 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.273925 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.274461 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.275024 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.275474 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.275852 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.276216 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.276559 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.276904 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.277236 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.277580 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.277943 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.278286 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.278623 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.278960 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.279284 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.279664 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.279996 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.280321 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.280647 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.280970 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.281315 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.281657 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.282032 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.282358 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.282674 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.283017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.283349 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.283680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.284151 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.284626 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.285368 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.287167 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.287579 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.288530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.288530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.288988 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.288988 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.289448 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.289739 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.289978 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.290278 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.290619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.290961 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.291331 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.291873 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.292117 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.292349 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.292730 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.292975 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.293265 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.293535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118108) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 18:28:13.364354 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO dbcounter [None req-e370c4ed-fb20-4728-820d-3d7850976201 None None] Registered counter for database nova_api Jun 21 18:28:13.395259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_db.sqlalchemy.engines [None req-e370c4ed-fb20-4728-820d-3d7850976201 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:28:13.401556 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writer thread running {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:28:13.433446 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 18:28:13.434302 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 18:28:13.434919 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 18:28:13.435583 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 18:28:13.436036 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 18:28:13.436714 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.437290 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.437901 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.438480 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.439076 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.439639 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.440218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.440870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.441475 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.441985 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.442556 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.443151 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844601-4-iscsi {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.443742 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.444316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.444888 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.445482 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.446074 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.446672 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.447236 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.448156 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.448805 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.449335 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.449923 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.450534 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.451102 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.451738 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.452382 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.452887 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.453487 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.454152 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.454866 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844601-4-iscsi {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.455453 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.456073 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.457602 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.458422 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.458994 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.459543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.460110 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.460682 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.461255 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.461903 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.462500 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.463072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.463648 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.464212 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.464774 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.465343 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.465991 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.466554 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.467098 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.467548 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.468112 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.468690 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.469277 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.469895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.470342 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.470788 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.471344 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.472144 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.473411 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.474003 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.474563 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.475121 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.475678 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.476250 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.476797 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.477349 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.477978 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.478528 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.479196 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.479678 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.480251 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.481184 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.87 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.481686 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.87 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.482290 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.482905 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.483466 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.484023 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.484601 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.485520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.486108 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.486663 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.487300 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.487882 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.488493 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.489057 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.489512 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.490110 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.490658 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.491242 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.492123 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.493151 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.493443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.494023 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.494575 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.495146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.495700 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.496257 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.496815 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.497372 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.497813 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.context [None req-e370c4ed-fb20-4728-820d-3d7850976201 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1ae3aa00-a91e-47d9-9392-29a47002ac79(cell1) {{(pid=118108) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 18:28:13.497969 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.498532 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.499090 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.499688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.500277 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.500829 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.501392 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.501996 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.502569 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.503421 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.503973 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.504546 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.505390 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.505985 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.506473 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.506758 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e370c4ed-fb20-4728-820d-3d7850976201 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:13.506991 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.507510 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.508076 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.508580 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.509040 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.509515 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.510068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.510222 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e370c4ed-fb20-4728-820d-3d7850976201 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:13.510684 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.511227 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.513367 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.513618 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e370c4ed-fb20-4728-820d-3d7850976201 None None] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:13.514168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.514168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.514168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.514168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.514714 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.514976 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.515578 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.516150 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.516337 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e370c4ed-fb20-4728-820d-3d7850976201 None None] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:13.516715 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.517252 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.517864 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.518536 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 18:28:13.519269 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.519660 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.520070 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.520396 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.520743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.521036 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO dbcounter [None req-e370c4ed-fb20-4728-820d-3d7850976201 None None] Registered counter for database nova_cell0 Jun 21 18:28:13.521202 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.521395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.521741 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.522062 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.522398 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.522745 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.523093 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.523484 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.523911 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.524321 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.524579 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.524975 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.525328 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.525764 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.526247 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.526778 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.527118 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.527448 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.527795 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.528457 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.528762 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.529107 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.529436 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.529803 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.530152 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.530457 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.530795 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.531120 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.531479 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO dbcounter [None req-e370c4ed-fb20-4728-820d-3d7850976201 None None] Registered counter for database nova_cell1 Jun 21 18:28:13.531656 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.531821 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.532131 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.532513 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.532883 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.533199 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.533715 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.534172 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.535616 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.536000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.536248 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.536655 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.537575 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.538264 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.538755 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.539337 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.539503 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.539964 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.540129 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.540340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.540721 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.541143 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.542010 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.542010 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.542287 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.543049 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.543049 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.543049 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.543049 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.544105 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.544232 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.544635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.544956 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.545295 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.545610 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.545950 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.546276 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.546654 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.546944 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_db.sqlalchemy.engines [None req-e370c4ed-fb20-4728-820d-3d7850976201 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:28:13.547219 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.547379 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.547600 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.547914 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.548217 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.548713 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.549053 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.549373 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.549782 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.550120 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.550458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.550902 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.551217 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.551574 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.552012 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.552257 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.552527 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.552941 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.553202 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_db.sqlalchemy.engines [None req-e370c4ed-fb20-4728-820d-3d7850976201 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:28:13.553461 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.553461 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.553939 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.554303 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.554560 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.555029 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.555029 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.555676 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.555676 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.556337 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.556337 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.556974 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.556974 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.557697 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.557697 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.558183 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.558430 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.558702 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.559080 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.559316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.559607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.559918 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.560231 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.560541 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.560851 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.561171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.561421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writer thread running {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:28:13.561707 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.561946 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.562179 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.562631 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.562881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.563137 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.563379 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.563605 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.564009 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.564277 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.564691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.564936 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.565323 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.565850 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.566271 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writer thread running {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:28:13.566526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.566766 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.567035 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.567468 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.567713 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.567947 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.568315 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.568631 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.568996 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.569335 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.569677 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.569987 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.570301 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.570698 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.570965 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.571451 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.571704 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.572164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.572482 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.572789 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.573100 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.573403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.573735 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.574041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.574357 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.574672 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.574979 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.575281 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.575591 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.575897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.576199 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.576501 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.576809 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.577133 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.577449 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.577785 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.578105 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.578407 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.578707 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.579026 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.579340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.579641 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.579960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.580361 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.580712 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.581228 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.581613 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.581941 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.582267 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.582576 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.582896 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.583224 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.583561 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.583888 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.584210 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.584518 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.584829 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.585137 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.585448 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.585782 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.586288 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.586539 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.586785 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.587073 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.587379 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.587900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.588156 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.588581 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.588911 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.589223 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.589538 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.589961 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.590279 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.590611 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.590938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.591284 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.591593 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.591902 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.592207 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.592509 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.592816 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.593115 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.593420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.593748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.594046 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.594346 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.594649 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.594950 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.595251 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.595569 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.595872 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.596178 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.596568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.596808 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.597123 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.597426 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.597784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.598269 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.598616 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.598921 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.599262 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.599621 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.599925 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.600292 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.600597 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.600918 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.601221 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.601520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.601848 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.602155 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.602462 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.602764 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.603071 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.603379 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.603694 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.604010 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.604543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.605083 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.605625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.606080 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.606545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.607017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.607526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.608095 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.608609 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.609206 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.609774 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.610676 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.611243 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.611790 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.612403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.613128 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.613739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.614286 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.614818 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.615413 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.615975 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.616536 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.617145 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.618001 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.618204 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.618737 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.619297 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.619882 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.620441 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.620987 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.621547 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.622130 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.622676 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.623145 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.623670 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.624195 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.624724 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.625255 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.625813 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.626343 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.626858 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.627394 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.628395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.628606 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.629013 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.629624 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.630190 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.630795 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.631326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.631823 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.632387 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.632943 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.633492 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.634090 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.634629 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.635173 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.635721 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.636216 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.636766 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.637290 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.637883 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.638528 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.639044 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.639535 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.640100 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.640697 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.641254 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.641865 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.642439 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.643001 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.643628 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.644188 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.645253 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.645885 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.646518 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.647017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.647579 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.648135 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.648700 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.649362 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.649869 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.650395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.650965 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.651517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.652080 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.652628 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.653193 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.653795 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.654559 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.655120 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.655670 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.656215 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.656772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.657327 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.657924 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.658488 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.659063 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.660255 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.660576 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.661027 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.661589 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.662175 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.662716 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.663278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.663868 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.664411 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.665018 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.665560 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.666173 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.666718 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.667289 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.668051 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.668609 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.669152 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.669930 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.670484 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.671044 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.671781 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.672199 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.672781 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.673333 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.673928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.674480 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.675307 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.675904 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.676466 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.677030 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.677579 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.678188 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.678765 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.679332 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.679908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.680672 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.681248 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.681840 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.682430 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.683008 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.683559 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.684101 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.684660 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.685522 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.686104 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.686689 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.687238 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.687800 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.688356 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.688918 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.689463 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.690040 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.690729 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.691186 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.692010 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.692583 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.693165 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.693777 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.694326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.694903 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.695453 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.695998 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.696540 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.697082 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.697729 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.698277 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.698848 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.699442 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.700028 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.700581 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.701215 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.701836 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.702407 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.702973 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.703556 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.704096 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.704638 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.705202 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.705816 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.708517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.708517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.708517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.709376 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.709972 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.710653 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.711344 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.713323 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.713323 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.714052 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.716109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.718926 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.718926 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.718926 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.720508 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.722529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.723287 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.723896 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.726184 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.726184 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.726803 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.727642 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.728223 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.728798 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.729374 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.729974 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.730545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.731176 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.731833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.732221 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.732787 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.733341 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.734403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.735345 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.735904 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.736458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.737016 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.738589 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.739181 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.739745 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.740319 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.740879 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.741444 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.742074 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.742655 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.743250 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.743847 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.744418 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.744981 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.745548 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.746138 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.746756 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.747319 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.747883 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.748460 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.749032 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.749602 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.750188 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.750752 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.751317 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.751883 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.752445 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.753054 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.753665 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.754571 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.755060 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.755674 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.756245 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.756807 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.757472 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.757957 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.758939 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.759489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.760095 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.760681 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.761258 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.761855 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.762412 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.763002 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.763555 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.764106 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.764658 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.765224 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.765788 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.766364 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.766920 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.767461 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.768030 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.768657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.770749 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.771377 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.771958 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.772545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.773124 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.773714 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.774269 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.774885 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.775398 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.775952 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.776519 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.777075 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.777612 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.778193 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.778754 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.779299 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.779837 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.780390 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.780937 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.781514 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.782086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.782632 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.783184 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.783743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.784549 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.785058 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.786023 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.786296 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.786768 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.787320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.787878 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.788426 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.788984 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.789533 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.790128 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.790752 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.791338 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.791890 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.792433 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.793008 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.793563 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.794183 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.794762 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.795316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.795935 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.796500 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.797521 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.798145 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.798716 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.799307 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.799959 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.800516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.801067 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.801611 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.802316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.802877 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.803437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.803995 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.804558 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.805124 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.805722 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.806273 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.806825 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.807374 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.807923 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.808498 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.813715 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.813715 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.813715 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.814844 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO dbcounter [None req-e370c4ed-fb20-4728-820d-3d7850976201 None None] Registered counter for database nova_cell0 Jun 21 18:28:13.815320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.815320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.815320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.815320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.815320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.815320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.815320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.815320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.817249 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.817249 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.817249 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.817249 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.818007 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.818714 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.819277 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.819852 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.820426 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.821733 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.821733 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.822116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.822639 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.823198 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.823734 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.824053 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_db.sqlalchemy.engines [None req-e370c4ed-fb20-4728-820d-3d7850976201 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118108) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:28:13.824731 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.824879 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.825478 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.826094 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.826633 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.827169 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.827718 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.828273 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.828838 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.829625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.830198 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.830745 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.831342 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.831731 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.832109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.832779 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.833171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.833582 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.834101 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writer thread running {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:28:13.834290 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.834505 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.834870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.835377 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.835673 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.836227 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.836810 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.837375 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.840916 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.840916 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.840916 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.840916 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.840916 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.840916 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.842063 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.842063 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.842547 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.843140 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.843712 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.844337 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.844922 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.845609 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.846135 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.846832 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.847378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.848033 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.848321 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.848628 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.849180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.849778 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.850397 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.850994 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.851562 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.852172 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.852776 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.853369 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.854001 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.854591 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.855211 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.855794 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.856373 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.856964 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.857543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.858158 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.858743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.859338 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.860276 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.860633 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.860955 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.861291 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.861663 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.862023 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.862386 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.862769 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.863075 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.863439 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.863874 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.864187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 18:28:13.864434 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118109) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 18:28:13.934816 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO dbcounter [None req-9b3ae0ca-0422-445a-8396-192b04222f9f None None] Registered counter for database nova_api Jun 21 18:28:13.961767 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_db.sqlalchemy.engines [None req-9b3ae0ca-0422-445a-8396-192b04222f9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:28:13.971577 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writer thread running {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:28:14.039855 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.context [None req-9b3ae0ca-0422-445a-8396-192b04222f9f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1ae3aa00-a91e-47d9-9392-29a47002ac79(cell1) {{(pid=118109) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 18:28:14.044461 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9b3ae0ca-0422-445a-8396-192b04222f9f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:14.046158 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9b3ae0ca-0422-445a-8396-192b04222f9f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:14.047026 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9b3ae0ca-0422-445a-8396-192b04222f9f None None] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:28:14.049110 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9b3ae0ca-0422-445a-8396-192b04222f9f None None] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:28:14.051354 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO dbcounter [None req-9b3ae0ca-0422-445a-8396-192b04222f9f None None] Registered counter for database nova_cell0 Jun 21 18:28:14.055905 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO dbcounter [None req-9b3ae0ca-0422-445a-8396-192b04222f9f None None] Registered counter for database nova_cell1 Jun 21 18:28:14.065168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_db.sqlalchemy.engines [None req-9b3ae0ca-0422-445a-8396-192b04222f9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:28:14.071330 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writer thread running {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:28:14.240219 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_db.sqlalchemy.engines [None req-9b3ae0ca-0422-445a-8396-192b04222f9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:28:14.245498 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writer thread running {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:28:14.259738 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO dbcounter [None req-9b3ae0ca-0422-445a-8396-192b04222f9f None None] Registered counter for database nova_cell0 Jun 21 18:28:14.270339 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_db.sqlalchemy.engines [None req-9b3ae0ca-0422-445a-8396-192b04222f9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 18:28:14.279692 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writer thread running {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 18:28:14.361956 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: WARNING keystonemiddleware.auth_token [None req-e370c4ed-fb20-4728-820d-3d7850976201 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:28:14.370952 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: WARNING keystonemiddleware.auth_token [None req-e370c4ed-fb20-4728-820d-3d7850976201 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:28:14.880673 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: WARNING keystonemiddleware.auth_token [None req-9b3ae0ca-0422-445a-8396-192b04222f9f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:28:14.895645 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: WARNING keystonemiddleware.auth_token [None req-9b3ae0ca-0422-445a-8396-192b04222f9f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:28:14.938679 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: WARNING keystonemiddleware.auth_token [None req-e370c4ed-fb20-4728-820d-3d7850976201 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:28:14.953764 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: WARNING keystonemiddleware.auth_token [None req-e370c4ed-fb20-4728-820d-3d7850976201 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:28:14.964962 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x55c91bd3e9c0 pid: 118108 (default app) Jun 21 18:28:15.513786 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: WARNING keystonemiddleware.auth_token [None req-9b3ae0ca-0422-445a-8396-192b04222f9f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 18:28:15.524525 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: WARNING keystonemiddleware.auth_token [None req-9b3ae0ca-0422-445a-8396-192b04222f9f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 18:28:15.534198 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x55c91bd3e9c0 pid: 118109 (default app) Jun 21 18:29:07.717164 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=3 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:07.722135 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=3 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:07.724633 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=3 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:07.727526 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=3 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:09.913381 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-782ab0e6-152f-4aee-bb33-4a3e4daf8281 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Action: 'create', calling method: .version_select at 0x7fd8b9031790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1686601831"}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:11.842766 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-782ab0e6-152f-4aee-bb33-4a3e4daf8281 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.164672 Jun 21 18:29:11.844389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 1/1] 10.222.0.87 () {60 vars in 1154 bytes} [Tue Jun 21 18:29:07 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4169 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 21 18:29:12.639608 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c295306b-576f-4450-bf50-acce5625223a tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Calling method '.version_select at 0x7fd8b90e4280>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:12.680056 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=3 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:12.681339 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=3 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:12.683404 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=3 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:12.684587 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=3 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:12.992894 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-05d0c9dd-aecb-4054-a08e-d4bbd1efc701 tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] Calling method '.version_select at 0x7fd8b8efb5e0>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:13.195521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-05d0c9dd-aecb-4054-a08e-d4bbd1efc701 tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/38f4a13e-3776-4880-9a07-d1d09d3622ed" status: 200 len: 350 microversion: 2.1 time: 0.210657 Jun 21 18:29:13.196799 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 2/2] 10.222.0.87 () {58 vars in 1244 bytes} [Tue Jun 21 18:29:12 2022] GET /compute/v2.1/os-volumes/38f4a13e-3776-4880-9a07-d1d09d3622ed => generated 350 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:29:13.963340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c295306b-576f-4450-bf50-acce5625223a tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/e9ea0e91-2a12-48a6-94ee-c9c51297065a" status: 200 len: 346 microversion: 2.1 time: 2.108347 Jun 21 18:29:13.965717 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 1/3] 10.222.0.87 () {58 vars in 1244 bytes} [Tue Jun 21 18:29:11 2022] GET /compute/v2.1/os-volumes/e9ea0e91-2a12-48a6-94ee-c9c51297065a => generated 346 bytes in 2113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:13.989014 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6a363fee-5f38-4d3f-91cf-0eb91f17209c tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Action: 'create', calling method: .version_select at 0x7fd8b8efb8b0>, body: {"snapshot": {"volume_id": "e9ea0e91-2a12-48a6-94ee-c9c51297065a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-357374211"}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:15.171395 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6a363fee-5f38-4d3f-91cf-0eb91f17209c tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] 10.222.0.87 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.188411 Jun 21 18:29:15.172967 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 3/4] 10.222.0.87 () {60 vars in 1161 bytes} [Tue Jun 21 18:29:13 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:15.192087 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-fc805b5d-7ff7-4341-a5d6-5fc1543a68a6 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Calling method '.version_select at 0x7fd8b8f3e550>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:15.354810 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-fc805b5d-7ff7-4341-a5d6-5fc1543a68a6 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33" status: 200 len: 286 microversion: 2.1 time: 0.170635 Jun 21 18:29:15.355622 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 2/5] 10.222.0.87 () {58 vars in 1250 bytes} [Tue Jun 21 18:29:15 2022] GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33 => generated 286 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:15.372726 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-aaecbb61-509e-4887-ac5e-bade6c7cad5a tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Calling method '.version_select at 0x7fd8b8e94280>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:15.494641 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-aaecbb61-509e-4887-ac5e-bade6c7cad5a tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.128799 Jun 21 18:29:15.495945 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 4/6] 10.222.0.87 () {58 vars in 1139 bytes} [Tue Jun 21 18:29:15 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:15.510436 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-3b48c148-afd3-4b50-8f7c-84a9c7d21101 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Calling method '.version_select at 0x7fd8b8f3e700>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:15.618785 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-3b48c148-afd3-4b50-8f7c-84a9c7d21101 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33" status: 200 len: 286 microversion: 2.1 time: 0.113340 Jun 21 18:29:15.620106 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 3/7] 10.222.0.87 () {58 vars in 1250 bytes} [Tue Jun 21 18:29:15 2022] GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33 => generated 286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:29:15.706672 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c86d74e7-6d75-483c-9463-bc026f1f8c00 tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] Calling method '.version_select at 0x7fd8b8e94f70>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:15.914942 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c86d74e7-6d75-483c-9463-bc026f1f8c00 tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/153136c9-25a6-4787-b953-fc6a98a96026" status: 200 len: 351 microversion: 2.1 time: 0.213393 Jun 21 18:29:15.916413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 5/8] 10.222.0.87 () {58 vars in 1244 bytes} [Tue Jun 21 18:29:15 2022] GET /compute/v2.1/os-volumes/153136c9-25a6-4787-b953-fc6a98a96026 => generated 351 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:16.634806 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f7363541-e4b2-4869-a14f-40b7c5e83afe tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Calling method '.version_select at 0x7fd8b8f3ed30>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:16.757052 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f7363541-e4b2-4869-a14f-40b7c5e83afe tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33" status: 200 len: 286 microversion: 2.1 time: 0.126005 Jun 21 18:29:16.757732 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 4/9] 10.222.0.87 () {58 vars in 1250 bytes} [Tue Jun 21 18:29:16 2022] GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33 => generated 286 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:29:17.781428 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2a223ebb-7783-4854-a7b0-8ef0ad22be36 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Calling method '.version_select at 0x7fd8b8e94b80>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:17.854542 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2a223ebb-7783-4854-a7b0-8ef0ad22be36 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33" status: 200 len: 286 microversion: 2.1 time: 0.086349 Jun 21 18:29:17.855932 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 6/10] 10.222.0.87 () {58 vars in 1250 bytes} [Tue Jun 21 18:29:17 2022] GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33 => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:18.875006 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8c3e07d0-50dc-4516-966f-8c9432256223 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Calling method '.version_select at 0x7fd8b8f044c0>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:18.982696 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8c3e07d0-50dc-4516-966f-8c9432256223 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33" status: 200 len: 286 microversion: 2.1 time: 0.115433 Jun 21 18:29:18.984537 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 5/11] 10.222.0.87 () {58 vars in 1250 bytes} [Tue Jun 21 18:29:18 2022] GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33 => generated 286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:19.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8c212c3a-71d0-401e-ac1a-fabe03443ac4 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Calling method '.version_select at 0x7fd8b8f3eca0>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:20.055887 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8c212c3a-71d0-401e-ac1a-fabe03443ac4 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33" status: 200 len: 286 microversion: 2.1 time: 0.061290 Jun 21 18:29:20.056792 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 6/12] 10.222.0.87 () {58 vars in 1250 bytes} [Tue Jun 21 18:29:19 2022] GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:20.529487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-0e7d4203-3ac9-4aae-8be1-fc01b3100222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2003940290", "imageRef": "c28659fb-c2d3-4dda-a330-1323a974987e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:20.869363 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.network.neutron [None req-0e7d4203-3ac9-4aae-8be1-fc01b3100222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] validate_networks() for [('d27fae01-b4c5-4fd5-b7cf-7de0a74abdb8', None, None, None, None, None)] {{(pid=118108) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:29:21.077077 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-efb4d007-7ac8-47a3-b724-08aa2b4f653e tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Calling method '.version_select at 0x7fd8b8f3e790>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:21.182370 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-efb4d007-7ac8-47a3-b724-08aa2b4f653e tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33" status: 200 len: 286 microversion: 2.1 time: 0.113171 Jun 21 18:29:21.184015 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 7/13] 10.222.0.87 () {58 vars in 1250 bytes} [Tue Jun 21 18:29:21 2022] GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33 => generated 286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:22.205339 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-17949933-04e1-4c82-9254-20f377850f90 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Calling method '.version_select at 0x7fd8b8f04700>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:22.285159 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-17949933-04e1-4c82-9254-20f377850f90 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33" status: 200 len: 287 microversion: 2.1 time: 0.086747 Jun 21 18:29:22.286245 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 8/14] 10.222.0.87 () {58 vars in 1250 bytes} [Tue Jun 21 18:29:22 2022] GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:22.303226 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-291f2413-3124-4994-9894-f7987d0cbff4 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Calling method '.version_select at 0x7fd8b8f3e700>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:22.523756 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-291f2413-3124-4994-9894-f7987d0cbff4 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] 10.222.0.87 "DELETE /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33" status: 202 len: 0 microversion: 2.1 time: 0.226443 Jun 21 18:29:22.524939 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 9/15] 10.222.0.87 () {58 vars in 1253 bytes} [Tue Jun 21 18:29:22 2022] DELETE /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:29:22.553944 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-090212bd-cb30-45e5-a4e5-b6b740d4ca66 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Calling method '.version_select at 0x7fd8b8f3ed30>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:22.711557 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-090212bd-cb30-45e5-a4e5-b6b740d4ca66 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33" status: 200 len: 286 microversion: 2.1 time: 0.179686 Jun 21 18:29:22.713122 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 10/16] 10.222.0.87 () {58 vars in 1250 bytes} [Tue Jun 21 18:29:22 2022] GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33 => generated 286 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:29:22.853590 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b67c83eb-5e13-4ce7-8414-11fa3e57e6ad tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] Calling method '.version_select at 0x7fd8b8f04790>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:23.227485 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b67c83eb-5e13-4ce7-8414-11fa3e57e6ad tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/d65c368e-f096-4872-8574-689518b1ca55" status: 200 len: 350 microversion: 2.1 time: 0.382346 Jun 21 18:29:23.231001 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 11/17] 10.222.0.87 () {58 vars in 1244 bytes} [Tue Jun 21 18:29:22 2022] GET /compute/v2.1/os-volumes/d65c368e-f096-4872-8574-689518b1ca55 => generated 350 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:23.267648 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-d34820d5-f076-4671-96db-ef0670e6229d tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] Calling method '.version_select at 0x7fd8b8f04c10>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:23.644186 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-d34820d5-f076-4671-96db-ef0670e6229d tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] 10.222.0.87 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.399046 Jun 21 18:29:23.645735 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 12/18] 10.222.0.87 () {58 vars in 1133 bytes} [Tue Jun 21 18:29:23 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:23.688571 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f0345638-adbe-478d-9b0b-369dfa335f36 tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] Calling method '.version_select at 0x7fd8b8f3e9d0>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:24.096372 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f0345638-adbe-478d-9b0b-369dfa335f36 tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] 10.222.0.87 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.433704 Jun 21 18:29:24.098060 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 13/19] 10.222.0.87 () {58 vars in 1148 bytes} [Tue Jun 21 18:29:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:24.133524 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-79c9f366-9db8-4758-8152-5eee5acb0880 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Calling method '.version_select at 0x7fd8b8f04a60>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:24.309803 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-79c9f366-9db8-4758-8152-5eee5acb0880 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] HTTP exception thrown: Snapshot 806edccd-d4d0-4cd6-87cb-5849996b1d33 could not be found. Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-79c9f366-9db8-4758-8152-5eee5acb0880 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Request method failure captured: Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33 HTTP/1.1 Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg3z6HK2Mb2FKXasREHMVLVpfnVa0fPD19UpV77-H2XDIHltudfQrwjaDCgncq38EfoyA0uyMtfdI1RMJrsoIIsqBta5p3mInBRplBYdPfs7qDh6-Ky2Z2skgzNdxXdHptCdFQIGv5fJBRj_HjIQNsxG8Y_c1-HbbNaJiBu8CHn676g Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: a7814d8e77554771b0aad9c0768d1b91 Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-745651003 Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:29:24.323759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:29:24.325306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a7814d8e77554771b0aad9c0768d1b91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/a7814d8e77554771b0aad9c0768d1b91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a7814d8e77554771b0aad9c0768d1b91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_a7814d8e77554771b0aad9c0768d1b91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:29:24.325306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-VolumesSnapshotsTestJSON-745651003 Jun 21 18:29:24.325306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: a7814d8e77554771b0aad9c0768d1b91 Jun 21 18:29:24.325306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-745651003 Jun 21 18:29:24.325306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-VolumesSnapshotsTestJSON-745651003-project Jun 21 18:29:24.325306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:29:24.325306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:29:24.325306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: 11342f921cf846c19bcf64211507b769 Jun 21 18:29:24.325306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-VolumesSnapshotsTestJSON-745651003-project Jun 21 18:29:24.325306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: Jun 21 18:29:24.325306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Snapshot 806edccd-d4d0-4cd6-87cb-5849996b1d33 could not be found. Jun 21 18:29:24.325306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': '806edccd-d4d0-4cd6-87cb-5849996b1d33'} Jun 21 18:29:24.325306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:29:24.326278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:24.326278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 18:29:24.326278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 18:29:24.326278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 18:29:24.326278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 18:29:24.326278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 18:29:24.326278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 18:29:24.326278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:29:24.326278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:29:24.326278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:29:24.326278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:29:24.326278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:29:24.326278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:29:24.326278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:29:24.326278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:29:24.326278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 806edccd-d4d0-4cd6-87cb-5849996b1d33 could not be found. (HTTP 404) (Request-ID: req-8ee34fc8-7ed9-45c7-93a1-209c9c862bc8) Jun 21 18:29:24.326278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:29:24.326278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:29:24.327529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:29:24.327529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:24.327529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 21 18:29:24.327529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 21 18:29:24.327529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 18:29:24.327529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 18:29:24.327529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 21 18:29:24.327529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 21 18:29:24.327529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 18:29:24.327529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 18:29:24.327529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 18:29:24.327529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 18:29:24.327529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 18:29:24.327529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 18:29:24.327529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 18:29:24.327529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 18:29:24.327529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:29:24.327529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:29:24.327529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 806edccd-d4d0-4cd6-87cb-5849996b1d33 could not be found. Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 21 18:29:24.328817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:29:24.330568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 806edccd-d4d0-4cd6-87cb-5849996b1d33 could not be found. Jun 21 18:29:24.330568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:29:24.330568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:29:24.330568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:29:24.330568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:24.330568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:29:24.330568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:29:24.330568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:29:24.330568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:29:24.330568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 806edccd-d4d0-4cd6-87cb-5849996b1d33 could not be found. Jun 21 18:29:24.330568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:29:24.330568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-79c9f366-9db8-4758-8152-5eee5acb0880 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Returning 404 to user: Snapshot 806edccd-d4d0-4cd6-87cb-5849996b1d33 could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:29:24.330568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-79c9f366-9db8-4758-8152-5eee5acb0880 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] 10.222.0.87 "GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33" status: 404 len: 111 microversion: 2.1 time: 0.226909 Jun 21 18:29:24.334179 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 14/20] 10.222.0.87 () {58 vars in 1250 bytes} [Tue Jun 21 18:29:24 2022] GET /compute/v2.1/os-snapshots/806edccd-d4d0-4cd6-87cb-5849996b1d33 => generated 111 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:29:24.344283 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-741e5561-fdff-4487-b81d-58e14c56ca9d tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] Calling method '.version_select at 0x7fd8b8f04310>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:24.678004 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-741e5561-fdff-4487-b81d-58e14c56ca9d tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] 10.222.0.87 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.340463 Jun 21 18:29:24.681244 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 15/21] 10.222.0.87 () {58 vars in 1133 bytes} [Tue Jun 21 18:29:24 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:24.699397 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e0bf63da-4ef7-4edc-bd3b-b5e0647c53ef tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Calling method '.version_select at 0x7fd8b8f12ee0>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:25.027471 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e0bf63da-4ef7-4edc-bd3b-b5e0647c53ef tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/e9ea0e91-2a12-48a6-94ee-c9c51297065a" status: 202 len: 0 microversion: 2.1 time: 0.344160 Jun 21 18:29:25.034871 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 16/22] 10.222.0.87 () {58 vars in 1247 bytes} [Tue Jun 21 18:29:24 2022] DELETE /compute/v2.1/os-volumes/e9ea0e91-2a12-48a6-94ee-c9c51297065a => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:29:25.051596 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-89ffe812-236c-49ef-97e0-4270518e6ee9 tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] Calling method '.version_select at 0x7fd8b8f12940>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:25.234822 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-0e7d4203-3ac9-4aae-8be1-fc01b3100222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Flavor limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:29:25.236540 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-0e7d4203-3ac9-4aae-8be1-fc01b3100222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Image limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:29:25.237094 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-0e7d4203-3ac9-4aae-8be1-fc01b3100222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Flavor pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:29:25.237519 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-0e7d4203-3ac9-4aae-8be1-fc01b3100222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Image pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:29:25.237980 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-0e7d4203-3ac9-4aae-8be1-fc01b3100222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:29:25.308041 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0e7d4203-3ac9-4aae-8be1-fc01b3100222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:25.309097 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0e7d4203-3ac9-4aae-8be1-fc01b3100222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:25.309901 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0e7d4203-3ac9-4aae-8be1-fc01b3100222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:25.319272 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0e7d4203-3ac9-4aae-8be1-fc01b3100222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:25.449529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-89ffe812-236c-49ef-97e0-4270518e6ee9 tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] 10.222.0.87 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.419234 Jun 21 18:29:25.451475 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 17/23] 10.222.0.87 () {58 vars in 1166 bytes} [Tue Jun 21 18:29:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:25.470396 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-0e7d4203-3ac9-4aae-8be1-fc01b3100222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Getting quotas for project 6538654ef94d4036a7a8d5614b80b0ed. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:29:25.480214 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-0a4ba71f-b6c2-48b8-9ea4-f80524c19da3 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Calling method '.version_select at 0x7fd8b8e72040>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:25.492321 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-0e7d4203-3ac9-4aae-8be1-fc01b3100222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Getting quotas for user de09b91800314d06aeddafe3c12a77b3 and project 6538654ef94d4036a7a8d5614b80b0ed. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:29:25.553025 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-0a4ba71f-b6c2-48b8-9ea4-f80524c19da3 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] HTTP exception thrown: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-0a4ba71f-b6c2-48b8-9ea4-f80524c19da3 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Request method failure captured: Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: GET /compute/v2.1/os-volumes/e9ea0e91-2a12-48a6-94ee-c9c51297065a HTTP/1.1 Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg3z6HK2Mb2FKXasREHMVLVpfnVa0fPD19UpV77-H2XDIHltudfQrwjaDCgncq38EfoyA0uyMtfdI1RMJrsoIIsqBta5p3mInBRplBYdPfs7qDh6-Ky2Z2skgzNdxXdHptCdFQIGv5fJBRj_HjIQNsxG8Y_c1-HbbNaJiBu8CHn676g Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: a7814d8e77554771b0aad9c0768d1b91 Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-745651003 Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:29:25.556437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:29:25.557486 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a7814d8e77554771b0aad9c0768d1b91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/a7814d8e77554771b0aad9c0768d1b91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a7814d8e77554771b0aad9c0768d1b91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_a7814d8e77554771b0aad9c0768d1b91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:29:25.557486 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-VolumesSnapshotsTestJSON-745651003 Jun 21 18:29:25.557486 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: a7814d8e77554771b0aad9c0768d1b91 Jun 21 18:29:25.557486 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-745651003 Jun 21 18:29:25.557486 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-VolumesSnapshotsTestJSON-745651003-project Jun 21 18:29:25.557486 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:29:25.557486 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:29:25.557486 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: 11342f921cf846c19bcf64211507b769 Jun 21 18:29:25.557486 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-VolumesSnapshotsTestJSON-745651003-project Jun 21 18:29:25.557486 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: Jun 21 18:29:25.557486 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. Jun 21 18:29:25.557486 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': 'e9ea0e91-2a12-48a6-94ee-c9c51297065a'} Jun 21 18:29:25.557486 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:29:25.558171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:25.558171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:29:25.558171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:29:25.558171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 18:29:25.558171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 18:29:25.558171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 18:29:25.558171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 18:29:25.558171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:29:25.558171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:29:25.558171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:29:25.558171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:29:25.558171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:29:25.558171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:29:25.558171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:29:25.558171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:29:25.558171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. (HTTP 404) (Request-ID: req-ea0f5fe0-c3ca-486e-8cd6-8012fe3e8670) Jun 21 18:29:25.558171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:29:25.558171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:29:25.558171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:29:25.559928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:25.559928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 18:29:25.559928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 18:29:25.559928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 18:29:25.559928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 18:29:25.559928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 18:29:25.559928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 18:29:25.559928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 18:29:25.559928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 18:29:25.559928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:29:25.559928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:29:25.559928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 18:29:25.559928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 18:29:25.559928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 18:29:25.559928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 18:29:25.559928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:29:25.559928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:29:25.559928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:29:25.559928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:29:25.560833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:29:25.560833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:29:25.560833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:29:25.560833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:29:25.560833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. Jun 21 18:29:25.560833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:29:25.560833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:29:25.560833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:29:25.560833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:25.560833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:29:25.560833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:29:25.560833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:29:25.560833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:29:25.560833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:29:25.560833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:29:25.560833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:29:25.560833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:29:25.560833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 18:29:25.560833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:29:25.561760 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. Jun 21 18:29:25.561760 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:29:25.561760 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:29:25.561760 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:29:25.561760 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:25.561760 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:29:25.561760 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:29:25.561760 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:29:25.561760 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:29:25.561760 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. Jun 21 18:29:25.561760 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:29:25.561760 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-0a4ba71f-b6c2-48b8-9ea4-f80524c19da3 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Returning 404 to user: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:29:25.561760 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-0a4ba71f-b6c2-48b8-9ea4-f80524c19da3 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/e9ea0e91-2a12-48a6-94ee-c9c51297065a" status: 404 len: 109 microversion: 2.1 time: 0.105016 Jun 21 18:29:25.561760 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 18/24] 10.222.0.87 () {58 vars in 1244 bytes} [Tue Jun 21 18:29:25 2022] GET /compute/v2.1/os-volumes/e9ea0e91-2a12-48a6-94ee-c9c51297065a => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:29:25.564543 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-0e7d4203-3ac9-4aae-8be1-fc01b3100222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Going to run 1 instances... {{(pid=118108) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:29:25.568352 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-0e7d4203-3ac9-4aae-8be1-fc01b3100222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c28659fb-c2d3-4dda-a330-1323a974987e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118108) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:29:25.572985 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-90cb2a6d-b4ee-4af6-a389-6b8595850cf3 tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] Calling method '.version_select at 0x7fd8b8f04280>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:25.727683 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-0e7d4203-3ac9-4aae-8be1-fc01b3100222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.841121 Jun 21 18:29:25.730466 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 7/25] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:29:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 5845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:29:25.752283 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-13c1e30c-aece-46bc-8162-911b6aeb81e1 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Calling method '.version_select at 0x7fd8b85a0160>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:25.851303 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-90cb2a6d-b4ee-4af6-a389-6b8595850cf3 tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.291110 Jun 21 18:29:25.852464 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 19/26] 10.222.0.87 () {58 vars in 1169 bytes} [Tue Jun 21 18:29:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:25.860122 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bae109fb-8e36-4421-a0c8-364a4cac151e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:25.860122 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-bae109fb-8e36-4421-a0c8-364a4cac151e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:25.918614 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-13c1e30c-aece-46bc-8162-911b6aeb81e1 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] HTTP exception thrown: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-13c1e30c-aece-46bc-8162-911b6aeb81e1 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Request method failure captured: Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: DELETE /compute/v2.1/os-volumes/e9ea0e91-2a12-48a6-94ee-c9c51297065a HTTP/1.1 Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABisg3z6HK2Mb2FKXasREHMVLVpfnVa0fPD19UpV77-H2XDIHltudfQrwjaDCgncq38EfoyA0uyMtfdI1RMJrsoIIsqBta5p3mInBRplBYdPfs7qDh6-Ky2Z2skgzNdxXdHptCdFQIGv5fJBRj_HjIQNsxG8Y_c1-HbbNaJiBu8CHn676g Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: a7814d8e77554771b0aad9c0768d1b91 Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-745651003 Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:29:25.924144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:29:25.925301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a7814d8e77554771b0aad9c0768d1b91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/a7814d8e77554771b0aad9c0768d1b91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a7814d8e77554771b0aad9c0768d1b91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_a7814d8e77554771b0aad9c0768d1b91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:29:25.925301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-VolumesSnapshotsTestJSON-745651003 Jun 21 18:29:25.925301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: a7814d8e77554771b0aad9c0768d1b91 Jun 21 18:29:25.925301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-745651003 Jun 21 18:29:25.925301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-VolumesSnapshotsTestJSON-745651003-project Jun 21 18:29:25.925301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:29:25.925301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:29:25.925301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 11342f921cf846c19bcf64211507b769 Jun 21 18:29:25.925301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-VolumesSnapshotsTestJSON-745651003-project Jun 21 18:29:25.925301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: Jun 21 18:29:25.925301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. Jun 21 18:29:25.925301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': 'e9ea0e91-2a12-48a6-94ee-c9c51297065a'} Jun 21 18:29:25.925301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:29:25.925986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:25.925986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:29:25.925986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:29:25.925986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 18:29:25.925986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 18:29:25.925986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 18:29:25.925986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 18:29:25.925986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 18:29:25.925986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 18:29:25.925986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 18:29:25.925986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 18:29:25.925986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:29:25.925986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:29:25.925986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:29:25.925986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:29:25.925986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. (HTTP 404) (Request-ID: req-1b5f065d-f8c8-4174-bc78-792f5f7d2298) Jun 21 18:29:25.925986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:29:25.925986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:29:25.925986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:29:25.927008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:25.927008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 18:29:25.927008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 18:29:25.927008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 18:29:25.927008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 18:29:25.927008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 18:29:25.927008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 18:29:25.927008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 18:29:25.927008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 18:29:25.927008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:29:25.927008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:29:25.927008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 18:29:25.927008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 18:29:25.927008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 18:29:25.927008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 18:29:25.927008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 18:29:25.927008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 18:29:25.927008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 18:29:25.927008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 18:29:25.927934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:29:25.927934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:29:25.927934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:29:25.927934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:29:25.927934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. Jun 21 18:29:25.927934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:29:25.927934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:29:25.927934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:29:25.927934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:25.927934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:29:25.927934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:29:25.927934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:29:25.927934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:29:25.927934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:29:25.927934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:29:25.927934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:29:25.927934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:29:25.927934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 18:29:25.927934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:29:25.931313 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. Jun 21 18:29:25.931313 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:29:25.931313 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:29:25.931313 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:29:25.931313 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:25.931313 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:29:25.931313 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:29:25.931313 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:29:25.931313 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:29:25.931313 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. Jun 21 18:29:25.931313 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:29:25.936948 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-13c1e30c-aece-46bc-8162-911b6aeb81e1 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Returning 404 to user: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:29:25.941390 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-13c1e30c-aece-46bc-8162-911b6aeb81e1 tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/e9ea0e91-2a12-48a6-94ee-c9c51297065a" status: 404 len: 109 microversion: 2.1 time: 0.204281 Jun 21 18:29:25.943805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 8/27] 10.222.0.87 () {58 vars in 1247 bytes} [Tue Jun 21 18:29:25 2022] DELETE /compute/v2.1/os-volumes/e9ea0e91-2a12-48a6-94ee-c9c51297065a => generated 109 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:29:25.953903 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a98a3d69-4e3a-433e-a5b0-e8804bfbc3a2 tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] Calling method '.version_select at 0x7fd8b985faf0>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:26.292234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a98a3d69-4e3a-433e-a5b0-e8804bfbc3a2 tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.346617 Jun 21 18:29:26.293565 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 9/28] 10.222.0.87 () {58 vars in 1154 bytes} [Tue Jun 21 18:29:25 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:26.306621 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a0646a1b-2ba0-45a7-9d32-b541a716b1cc tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Calling method '.version_select at 0x7fd8b85a03a0>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:26.373523 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-a0646a1b-2ba0-45a7-9d32-b541a716b1cc tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] HTTP exception thrown: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a0646a1b-2ba0-45a7-9d32-b541a716b1cc tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Request method failure captured: Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/os-volumes/e9ea0e91-2a12-48a6-94ee-c9c51297065a HTTP/1.1 Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABisg3z6HK2Mb2FKXasREHMVLVpfnVa0fPD19UpV77-H2XDIHltudfQrwjaDCgncq38EfoyA0uyMtfdI1RMJrsoIIsqBta5p3mInBRplBYdPfs7qDh6-Ky2Z2skgzNdxXdHptCdFQIGv5fJBRj_HjIQNsxG8Y_c1-HbbNaJiBu8CHn676g Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: a7814d8e77554771b0aad9c0768d1b91 Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-745651003 Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:29:26.377442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:29:26.380039 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a7814d8e77554771b0aad9c0768d1b91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/a7814d8e77554771b0aad9c0768d1b91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/a7814d8e77554771b0aad9c0768d1b91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_a7814d8e77554771b0aad9c0768d1b91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:29:26.380039 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-VolumesSnapshotsTestJSON-745651003 Jun 21 18:29:26.380039 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: a7814d8e77554771b0aad9c0768d1b91 Jun 21 18:29:26.380039 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-745651003 Jun 21 18:29:26.380039 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-VolumesSnapshotsTestJSON-745651003-project Jun 21 18:29:26.380039 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:29:26.380039 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:29:26.380039 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 11342f921cf846c19bcf64211507b769 Jun 21 18:29:26.380039 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-VolumesSnapshotsTestJSON-745651003-project Jun 21 18:29:26.380039 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: Jun 21 18:29:26.380039 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. Jun 21 18:29:26.380039 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': 'e9ea0e91-2a12-48a6-94ee-c9c51297065a'} Jun 21 18:29:26.380039 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:29:26.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:26.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:29:26.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:29:26.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 18:29:26.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 18:29:26.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 18:29:26.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 18:29:26.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:29:26.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:29:26.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:29:26.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:29:26.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:29:26.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:29:26.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:29:26.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:29:26.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. (HTTP 404) (Request-ID: req-40bc047b-d98b-403c-9ddc-4cb996ee353d) Jun 21 18:29:26.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:29:26.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:29:26.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:29:26.393723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:26.393723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 18:29:26.393723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 18:29:26.393723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 18:29:26.393723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 18:29:26.393723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 18:29:26.393723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 18:29:26.393723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 18:29:26.393723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 18:29:26.393723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:29:26.393723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:29:26.393723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 18:29:26.393723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 18:29:26.393723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 18:29:26.393723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 18:29:26.393723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:29:26.393723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:29:26.393723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:29:26.393723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:29:26.398413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:29:26.398413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:29:26.398413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:29:26.398413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:29:26.398413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. Jun 21 18:29:26.398413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:29:26.398413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:29:26.398413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:29:26.398413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:26.398413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:29:26.398413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:29:26.398413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:29:26.398413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:29:26.398413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:29:26.398413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:29:26.398413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:29:26.398413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:29:26.398413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 18:29:26.398413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:29:26.405615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. Jun 21 18:29:26.405615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:29:26.405615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:29:26.405615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:29:26.405615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:29:26.405615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:29:26.405615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:29:26.405615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:29:26.405615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:29:26.405615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. Jun 21 18:29:26.405615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:29:26.405615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a0646a1b-2ba0-45a7-9d32-b541a716b1cc tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] Returning 404 to user: Volume e9ea0e91-2a12-48a6-94ee-c9c51297065a could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:29:26.405615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a0646a1b-2ba0-45a7-9d32-b541a716b1cc tempest-VolumesSnapshotsTestJSON-745651003 tempest-VolumesSnapshotsTestJSON-745651003-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/e9ea0e91-2a12-48a6-94ee-c9c51297065a" status: 404 len: 109 microversion: 2.1 time: 0.077000 Jun 21 18:29:26.405615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 10/29] 10.222.0.87 () {58 vars in 1244 bytes} [Tue Jun 21 18:29:26 2022] GET /compute/v2.1/os-volumes/e9ea0e91-2a12-48a6-94ee-c9c51297065a => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:29:26.409740 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-68f8c021-9626-427a-a376-fc0108c86e00 tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] Calling method '.version_select at 0x7fd8b8591820>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:26.580990 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-bae109fb-8e36-4421-a0c8-364a4cac151e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:26.654761 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-bae109fb-8e36-4421-a0c8-364a4cac151e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1222 microversion: 2.1 time: 0.800586 Jun 21 18:29:26.655855 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 20/30] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:25 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1222 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:26.729338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-68f8c021-9626-427a-a376-fc0108c86e00 tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.346533 Jun 21 18:29:26.731836 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 11/31] 10.222.0.87 () {58 vars in 1187 bytes} [Tue Jun 21 18:29:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:26.752520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bb3d8e5e-a302-467c-8854-9d4204e86542 tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] Calling method '.version_select at 0x7fd8b8f123a0>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:27.003774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2d0cf4ec-ae64-4084-b73c-59cef7d16652 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-338909318", "imageRef": "c28659fb-c2d3-4dda-a330-1323a974987e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:27.247536 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-bb3d8e5e-a302-467c-8854-9d4204e86542 tempest-VolumesTestJSON-1027544744 tempest-VolumesTestJSON-1027544744-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.503251 Jun 21 18:29:27.248963 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 21/32] 10.222.0.87 () {58 vars in 1154 bytes} [Tue Jun 21 18:29:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:27.258300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.network.neutron [None req-2d0cf4ec-ae64-4084-b73c-59cef7d16652 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] validate_networks() for [('d27fae01-b4c5-4fd5-b7cf-7de0a74abdb8', None, None, None, None, None)] {{(pid=118108) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:29:27.916367 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-0e2dbfa1-7ff7-462f-a872-3de0e40f04a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1359689036", "imageRef": "c28659fb-c2d3-4dda-a330-1323a974987e", "flavorRef": "452", "networks": [{"uuid": "cedc7130-cb27-4249-b6e1-2b04130e9ec4"}]}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:28.294257 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.network.neutron [None req-0e2dbfa1-7ff7-462f-a872-3de0e40f04a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] validate_networks() for [('cedc7130-cb27-4249-b6e1-2b04130e9ec4', None, None, None, None, None)] {{(pid=118109) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:29:32.210427 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-2d0cf4ec-ae64-4084-b73c-59cef7d16652 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Flavor limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:29:32.211201 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-2d0cf4ec-ae64-4084-b73c-59cef7d16652 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Image limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:29:32.212363 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-2d0cf4ec-ae64-4084-b73c-59cef7d16652 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Flavor pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:29:32.213093 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-2d0cf4ec-ae64-4084-b73c-59cef7d16652 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Image pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:29:32.213862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-2d0cf4ec-ae64-4084-b73c-59cef7d16652 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:29:32.263102 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2d0cf4ec-ae64-4084-b73c-59cef7d16652 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:32.272492 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2d0cf4ec-ae64-4084-b73c-59cef7d16652 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:32.274246 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2d0cf4ec-ae64-4084-b73c-59cef7d16652 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:32.275027 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2d0cf4ec-ae64-4084-b73c-59cef7d16652 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:32.398340 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-2d0cf4ec-ae64-4084-b73c-59cef7d16652 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Getting quotas for project 6538654ef94d4036a7a8d5614b80b0ed. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:29:32.423415 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-2d0cf4ec-ae64-4084-b73c-59cef7d16652 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Getting quotas for user de09b91800314d06aeddafe3c12a77b3 and project 6538654ef94d4036a7a8d5614b80b0ed. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:29:32.467532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-2d0cf4ec-ae64-4084-b73c-59cef7d16652 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Going to run 1 instances... {{(pid=118108) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:29:32.475407 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-2d0cf4ec-ae64-4084-b73c-59cef7d16652 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c28659fb-c2d3-4dda-a330-1323a974987e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118108) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:29:32.614059 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2d0cf4ec-ae64-4084-b73c-59cef7d16652 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.617169 Jun 21 18:29:32.615515 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 12/33] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:29:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 5620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:29:32.628380 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-06d31ce8-52d1-471d-8efb-a58f63314fab tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:32.629011 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-06d31ce8-52d1-471d-8efb-a58f63314fab tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:33.310621 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-06d31ce8-52d1-471d-8efb-a58f63314fab tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:33.343180 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-06d31ce8-52d1-471d-8efb-a58f63314fab tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1221 microversion: 2.1 time: 0.718644 Jun 21 18:29:33.346079 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 13/34] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:32 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1221 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:34.374261 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-914be56c-2b6b-434a-bdd3-6015c62eeaff tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:34.374261 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-914be56c-2b6b-434a-bdd3-6015c62eeaff tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:35.248996 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-914be56c-2b6b-434a-bdd3-6015c62eeaff tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:35.295111 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-914be56c-2b6b-434a-bdd3-6015c62eeaff tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1221 microversion: 2.1 time: 0.934267 Jun 21 18:29:35.303688 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 14/35] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:34 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1221 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:35.349306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-0e2dbfa1-7ff7-462f-a872-3de0e40f04a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Flavor limits 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:29:35.350099 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-0e2dbfa1-7ff7-462f-a872-3de0e40f04a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Image limits 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:29:35.351136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-0e2dbfa1-7ff7-462f-a872-3de0e40f04a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Flavor pref 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:29:35.352113 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-0e2dbfa1-7ff7-462f-a872-3de0e40f04a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Image pref 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:29:35.353006 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-0e2dbfa1-7ff7-462f-a872-3de0e40f04a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:29:35.467996 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0e2dbfa1-7ff7-462f-a872-3de0e40f04a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:35.468965 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0e2dbfa1-7ff7-462f-a872-3de0e40f04a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:35.470621 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0e2dbfa1-7ff7-462f-a872-3de0e40f04a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:35.471542 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0e2dbfa1-7ff7-462f-a872-3de0e40f04a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:35.704924 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-0e2dbfa1-7ff7-462f-a872-3de0e40f04a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Getting quotas for project ad7bfb54384a4d648245aaf12c05ade7. Resources: {'instances', 'ram', 'cores'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:29:35.724047 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-0e2dbfa1-7ff7-462f-a872-3de0e40f04a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Getting quotas for user a03657e872e94266b12d95a602038cda and project ad7bfb54384a4d648245aaf12c05ade7. Resources: {'instances', 'ram', 'cores'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:29:35.755274 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-0e2dbfa1-7ff7-462f-a872-3de0e40f04a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Going to run 1 instances... {{(pid=118109) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:29:35.762411 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-0e2dbfa1-7ff7-462f-a872-3de0e40f04a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c28659fb-c2d3-4dda-a330-1323a974987e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118109) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:29:36.075094 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-0e2dbfa1-7ff7-462f-a872-3de0e40f04a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.506687 Jun 21 18:29:36.076094 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 22/36] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:29:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 8509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 18:29:36.110646 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-0dd81ae5-f46c-41d2-9b8c-6134cb659224 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:36.113593 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-0dd81ae5-f46c-41d2-9b8c-6134cb659224 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:36.325184 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-7d8f5dd7-386e-4c8d-a69d-682a8b9dc046 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:36.325947 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-7d8f5dd7-386e-4c8d-a69d-682a8b9dc046 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:36.363266 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7d8f5dd7-386e-4c8d-a69d-682a8b9dc046 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:36.364284 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7d8f5dd7-386e-4c8d-a69d-682a8b9dc046 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:36.378756 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7d8f5dd7-386e-4c8d-a69d-682a8b9dc046 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:36.379754 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7d8f5dd7-386e-4c8d-a69d-682a8b9dc046 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:36.973700 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-0dd81ae5-f46c-41d2-9b8c-6134cb659224 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:37.050930 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-0dd81ae5-f46c-41d2-9b8c-6134cb659224 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1215 microversion: 2.1 time: 0.963424 Jun 21 18:29:37.055520 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 15/37] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:36 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1215 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:37.540891 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-7d8f5dd7-386e-4c8d-a69d-682a8b9dc046 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:37.579607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-7d8f5dd7-386e-4c8d-a69d-682a8b9dc046 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1217 microversion: 2.1 time: 1.261910 Jun 21 18:29:37.596845 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 23/38] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:36 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1217 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:38.071761 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a76dc416-3434-4728-ac24-d18814ec716f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:38.072663 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-a76dc416-3434-4728-ac24-d18814ec716f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:38.619654 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-02a3cefc-716f-4ac4-a168-7eaa4a5a6c96 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:38.620549 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-02a3cefc-716f-4ac4-a168-7eaa4a5a6c96 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:38.637317 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-02a3cefc-716f-4ac4-a168-7eaa4a5a6c96 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:38.638602 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-02a3cefc-716f-4ac4-a168-7eaa4a5a6c96 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:38.640514 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-02a3cefc-716f-4ac4-a168-7eaa4a5a6c96 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:38.645304 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-02a3cefc-716f-4ac4-a168-7eaa4a5a6c96 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:39.404494 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-a76dc416-3434-4728-ac24-d18814ec716f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:39.415044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a76dc416-3434-4728-ac24-d18814ec716f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1215 microversion: 2.1 time: 1.346703 Jun 21 18:29:39.415662 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 16/39] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:38 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1215 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:39.532275 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-02a3cefc-716f-4ac4-a168-7eaa4a5a6c96 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:39.541234 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-02a3cefc-716f-4ac4-a168-7eaa4a5a6c96 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1279 microversion: 2.1 time: 0.926111 Jun 21 18:29:39.550874 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 24/40] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:38 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1279 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:40.443854 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-3fafc8c8-6fae-4e81-b528-1d65f2e5e6d2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:40.444518 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-3fafc8c8-6fae-4e81-b528-1d65f2e5e6d2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:40.469987 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3fafc8c8-6fae-4e81-b528-1d65f2e5e6d2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:40.470527 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3fafc8c8-6fae-4e81-b528-1d65f2e5e6d2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:40.475076 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3fafc8c8-6fae-4e81-b528-1d65f2e5e6d2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:40.475530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3fafc8c8-6fae-4e81-b528-1d65f2e5e6d2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:40.583955 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-3c54305f-e15c-4a84-a329-95859597029a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:40.585663 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-3c54305f-e15c-4a84-a329-95859597029a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:40.607131 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3c54305f-e15c-4a84-a329-95859597029a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:40.621025 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3c54305f-e15c-4a84-a329-95859597029a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:40.627562 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3c54305f-e15c-4a84-a329-95859597029a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:40.629304 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3c54305f-e15c-4a84-a329-95859597029a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:41.188254 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-3fafc8c8-6fae-4e81-b528-1d65f2e5e6d2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:41.204525 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-3c54305f-e15c-4a84-a329-95859597029a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:41.240277 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-3c54305f-e15c-4a84-a329-95859597029a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1279 microversion: 2.1 time: 0.664504 Jun 21 18:29:41.241027 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 25/41] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:40 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1279 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:41.250191 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-3fafc8c8-6fae-4e81-b528-1d65f2e5e6d2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1285 microversion: 2.1 time: 0.809879 Jun 21 18:29:41.252921 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 17/42] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:40 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1285 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:42.277064 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-73a0ec25-e9e2-415a-b204-b97d96997941 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:42.277696 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-8add0beb-6a19-463a-a155-b990945d818d tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:42.278951 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-8add0beb-6a19-463a-a155-b990945d818d tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:42.279321 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-73a0ec25-e9e2-415a-b204-b97d96997941 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:42.318921 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8add0beb-6a19-463a-a155-b990945d818d tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:42.321800 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-73a0ec25-e9e2-415a-b204-b97d96997941 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:42.322855 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-73a0ec25-e9e2-415a-b204-b97d96997941 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:42.325297 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-73a0ec25-e9e2-415a-b204-b97d96997941 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:42.327483 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8add0beb-6a19-463a-a155-b990945d818d tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:42.327588 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-73a0ec25-e9e2-415a-b204-b97d96997941 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:42.328397 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8add0beb-6a19-463a-a155-b990945d818d tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:42.329386 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8add0beb-6a19-463a-a155-b990945d818d tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:42.336599 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=4 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:42.742297 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-8add0beb-6a19-463a-a155-b990945d818d tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:42.755589 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-8add0beb-6a19-463a-a155-b990945d818d tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1273 microversion: 2.1 time: 0.489133 Jun 21 18:29:42.764394 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 18/43] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:42 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1273 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:43.169023 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-73a0ec25-e9e2-415a-b204-b97d96997941 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:43.217451 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-73a0ec25-e9e2-415a-b204-b97d96997941 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1279 microversion: 2.1 time: 0.954835 Jun 21 18:29:43.220949 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 26/44] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:42 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1279 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:43.803522 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-1e3efbdb-87e7-43c2-9816-f617134e8da2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:43.804898 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-1e3efbdb-87e7-43c2-9816-f617134e8da2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:43.869915 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1e3efbdb-87e7-43c2-9816-f617134e8da2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:43.870541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1e3efbdb-87e7-43c2-9816-f617134e8da2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:43.884109 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1e3efbdb-87e7-43c2-9816-f617134e8da2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:43.884913 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1e3efbdb-87e7-43c2-9816-f617134e8da2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:44.244519 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-eb95a7eb-dfdf-49bf-8752-72b652b6dd52 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:44.246866 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-eb95a7eb-dfdf-49bf-8752-72b652b6dd52 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:44.291906 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-eb95a7eb-dfdf-49bf-8752-72b652b6dd52 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:44.294544 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-eb95a7eb-dfdf-49bf-8752-72b652b6dd52 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:44.297511 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-eb95a7eb-dfdf-49bf-8752-72b652b6dd52 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:44.299515 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-eb95a7eb-dfdf-49bf-8752-72b652b6dd52 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:44.888453 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-1e3efbdb-87e7-43c2-9816-f617134e8da2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:44.933994 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-1e3efbdb-87e7-43c2-9816-f617134e8da2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1273 microversion: 2.1 time: 1.114630 Jun 21 18:29:44.934693 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 19/45] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:43 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1273 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:45.643451 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=2 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:45.751761 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=8 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:46.046573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-eb95a7eb-dfdf-49bf-8752-72b652b6dd52 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:46.066468 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-eb95a7eb-dfdf-49bf-8752-72b652b6dd52 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 1.823291 Jun 21 18:29:46.069178 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 27/46] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:44 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 1836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:46.719149 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-0643fd37-1fc1-4270-a7c6-9f6e11ffe38c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Action: 'create', calling method: .version_select at 0x7fd8b84ca040>, body: {"keypair": {"name": "tempest-keypair-1916343093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs+iQnVcvYEE0vUHlEOBHoYLswmaFaFk69ZmYrqtDy3iZavsO5CUGdbTVU2KgpfEemQvx/Y5BM4A6bqwFOke/CnewXNtX6lpA7VFrSdx6tOWKrAm8q3VK1nWvs90OS6ug=="}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:46.832580 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-0643fd37-1fc1-4270-a7c6-9f6e11ffe38c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Getting quotas for project 53e2bb9f793041c2aef6e222b76c3961. Resources: {'key_pairs'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:29:46.852120 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-0643fd37-1fc1-4270-a7c6-9f6e11ffe38c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Getting quotas for user 144c9c31ed9b469aa200dcb16c89ab4e and project 53e2bb9f793041c2aef6e222b76c3961. Resources: {'key_pairs'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:29:46.974663 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-0643fd37-1fc1-4270-a7c6-9f6e11ffe38c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.407863 Jun 21 18:29:46.980772 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 20/47] 10.222.0.87 () {60 vars in 1158 bytes} [Tue Jun 21 18:29:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:46.993219 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-156f2678-958d-431c-b5e5-0e5ecb460155 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:46.994272 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-156f2678-958d-431c-b5e5-0e5ecb460155 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:47.022090 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-156f2678-958d-431c-b5e5-0e5ecb460155 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:47.022585 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-156f2678-958d-431c-b5e5-0e5ecb460155 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:47.023458 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-156f2678-958d-431c-b5e5-0e5ecb460155 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:47.030050 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-156f2678-958d-431c-b5e5-0e5ecb460155 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:47.053968 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-ed679394-79d0-4cd8-879c-0b12a9df4d59 req-b111e7b9-d119-4e68-8df0-e52179d0df4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3e33553-dc4c-4e34-8533-beea14017592", "tag": "d4836e08-d41b-4ef2-b2c0-250ffcd31fdb"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:47.098613 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-ed679394-79d0-4cd8-879c-0b12a9df4d59 req-b111e7b9-d119-4e68-8df0-e52179d0df4a service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:47.108090 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-ed679394-79d0-4cd8-879c-0b12a9df4d59 req-b111e7b9-d119-4e68-8df0-e52179d0df4a service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:47.226682 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-ed679394-79d0-4cd8-879c-0b12a9df4d59 req-b111e7b9-d119-4e68-8df0-e52179d0df4a service nova] Creating event network-changed:d4836e08-d41b-4ef2-b2c0-250ffcd31fdb for instance c3e33553-dc4c-4e34-8533-beea14017592 on hv-cinder-84460 Jun 21 18:29:47.228557 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-ed679394-79d0-4cd8-879c-0b12a9df4d59 req-b111e7b9-d119-4e68-8df0-e52179d0df4a service nova] Acquired lock "compute-rpcapi-router" {{(pid=118109) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 18:29:47.233573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-74ba1a9d-00e2-42ed-84e3-4b6dcdb280a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:47.234100 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-74ba1a9d-00e2-42ed-84e3-4b6dcdb280a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:47.236074 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-74ba1a9d-00e2-42ed-84e3-4b6dcdb280a9 None None] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:47.239012 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-74ba1a9d-00e2-42ed-84e3-4b6dcdb280a9 None None] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:47.270199 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.compute.rpcapi [None req-74ba1a9d-00e2-42ed-84e3-4b6dcdb280a9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 18:29:47.272984 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-74ba1a9d-00e2-42ed-84e3-4b6dcdb280a9 None None] Releasing lock "compute-rpcapi-router" {{(pid=118109) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 18:29:47.322579 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-74ba1a9d-00e2-42ed-84e3-4b6dcdb280a9 None None] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.249627 Jun 21 18:29:47.323246 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 28/48] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:47.337307 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-aca2240c-4c22-4c26-a043-be34b0527dd3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:47.338550 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-aca2240c-4c22-4c26-a043-be34b0527dd3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:47.356717 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aca2240c-4c22-4c26-a043-be34b0527dd3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:47.359137 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aca2240c-4c22-4c26-a043-be34b0527dd3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:47.361257 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aca2240c-4c22-4c26-a043-be34b0527dd3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:47.362931 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aca2240c-4c22-4c26-a043-be34b0527dd3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:47.879801 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-156f2678-958d-431c-b5e5-0e5ecb460155 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:47.887039 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=27 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:47.889264 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-156f2678-958d-431c-b5e5-0e5ecb460155 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 0.902301 Jun 21 18:29:47.908441 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 21/49] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:46 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:48.186497 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-aca2240c-4c22-4c26-a043-be34b0527dd3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:48.206094 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-aca2240c-4c22-4c26-a043-be34b0527dd3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.879439 Jun 21 18:29:48.210320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 29/50] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:47 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:48.912564 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-9a5e744a-49df-4d96-a76e-ceda1eb019a4 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:48.916539 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-9a5e744a-49df-4d96-a76e-ceda1eb019a4 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:48.969212 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9a5e744a-49df-4d96-a76e-ceda1eb019a4 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:48.973486 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9a5e744a-49df-4d96-a76e-ceda1eb019a4 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:48.976785 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9a5e744a-49df-4d96-a76e-ceda1eb019a4 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:48.979777 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9a5e744a-49df-4d96-a76e-ceda1eb019a4 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:49.032954 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-17a26c17-5d3b-4737-a2b9-a011152dbaec tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Action: 'create', calling method: .version_select at 0x7fd8b84853a0>, body: {"keypair": {"name": "tempest-keypair-2010660305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIKnfrfc6AVYRcqdu3i1TCh0Yd0K8hxCl/ulgiG6tr8gvD3UbxVJaxUgTbM0B+8UVlmpVzUjxpGM2Ss2gv5YYjYDEEswbsd+5Qadi8qWvzpg6+dnV12V8CEKHeiL17tyw=="}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:49.057721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=7 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:49.087199 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=25 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:49.089183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-17a26c17-5d3b-4737-a2b9-a011152dbaec tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Getting quotas for project 3c88935a83d24e408c99cb711ae46257. Resources: {'key_pairs'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:29:49.108691 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-17a26c17-5d3b-4737-a2b9-a011152dbaec tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Getting quotas for user acf9a33e9fb941939010989a89a51d38 and project 3c88935a83d24e408c99cb711ae46257. Resources: {'key_pairs'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:29:49.240657 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-17a26c17-5d3b-4737-a2b9-a011152dbaec tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.330634 Jun 21 18:29:49.247865 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 22/51] 10.222.0.87 () {60 vars in 1158 bytes} [Tue Jun 21 18:29:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:49.265018 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6e8964d6-66f4-4b93-aeb3-9c0a6144dd9b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:49.268069 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-6e8964d6-66f4-4b93-aeb3-9c0a6144dd9b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:49.285801 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6e8964d6-66f4-4b93-aeb3-9c0a6144dd9b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:49.287581 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6e8964d6-66f4-4b93-aeb3-9c0a6144dd9b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:49.289487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6e8964d6-66f4-4b93-aeb3-9c0a6144dd9b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:49.290552 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6e8964d6-66f4-4b93-aeb3-9c0a6144dd9b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:50.446067 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6e8964d6-66f4-4b93-aeb3-9c0a6144dd9b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:50.481941 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6e8964d6-66f4-4b93-aeb3-9c0a6144dd9b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 1.231719 Jun 21 18:29:50.516904 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 23/52] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:49 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:50.673303 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-9a5e744a-49df-4d96-a76e-ceda1eb019a4 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:50.740013 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-9a5e744a-49df-4d96-a76e-ceda1eb019a4 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 1.826496 Jun 21 18:29:50.746203 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 30/53] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:48 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:51.522344 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-91e46ef8-fac3-4c65-9a0f-23db403fcdc1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:51.524276 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-91e46ef8-fac3-4c65-9a0f-23db403fcdc1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:51.556569 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-91e46ef8-fac3-4c65-9a0f-23db403fcdc1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:51.562530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-91e46ef8-fac3-4c65-9a0f-23db403fcdc1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:51.575878 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-91e46ef8-fac3-4c65-9a0f-23db403fcdc1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:51.576997 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-91e46ef8-fac3-4c65-9a0f-23db403fcdc1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:51.762766 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6850c1c6-6529-443b-b7a6-37d241dc473b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:51.763877 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6850c1c6-6529-443b-b7a6-37d241dc473b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:51.800536 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6850c1c6-6529-443b-b7a6-37d241dc473b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:51.801132 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6850c1c6-6529-443b-b7a6-37d241dc473b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:51.802293 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6850c1c6-6529-443b-b7a6-37d241dc473b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:51.802902 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6850c1c6-6529-443b-b7a6-37d241dc473b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:54.121254 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-6850c1c6-6529-443b-b7a6-37d241dc473b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:54.138744 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6850c1c6-6529-443b-b7a6-37d241dc473b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 2.381126 Jun 21 18:29:54.147669 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 31/54] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:51 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 2393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:29:54.158748 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-91e46ef8-fac3-4c65-9a0f-23db403fcdc1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:54.195369 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-91e46ef8-fac3-4c65-9a0f-23db403fcdc1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 2.678121 Jun 21 18:29:54.197222 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 24/55] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:51 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 2682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:55.161879 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2e9e7b14-c198-4a21-9531-cb8118a12afd tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:55.163285 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-2e9e7b14-c198-4a21-9531-cb8118a12afd tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:55.181992 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:55.192328 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2e9e7b14-c198-4a21-9531-cb8118a12afd tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:55.196426 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2e9e7b14-c198-4a21-9531-cb8118a12afd tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:55.198118 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2e9e7b14-c198-4a21-9531-cb8118a12afd tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:55.200671 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2e9e7b14-c198-4a21-9531-cb8118a12afd tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:55.235285 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5c1a63f8-6665-416f-9db3-137e0f3db815 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:55.236477 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-5c1a63f8-6665-416f-9db3-137e0f3db815 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:55.286974 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5c1a63f8-6665-416f-9db3-137e0f3db815 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:55.287936 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5c1a63f8-6665-416f-9db3-137e0f3db815 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:55.292791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5c1a63f8-6665-416f-9db3-137e0f3db815 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:55.294467 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5c1a63f8-6665-416f-9db3-137e0f3db815 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:57.259728 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-5c1a63f8-6665-416f-9db3-137e0f3db815 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:57.264540 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=2 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:57.333251 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-5c1a63f8-6665-416f-9db3-137e0f3db815 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 2.093181 Jun 21 18:29:57.341093 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2e9e7b14-c198-4a21-9531-cb8118a12afd tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:57.350956 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 25/56] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:55 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 2120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:57.374577 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-2e9e7b14-c198-4a21-9531-cb8118a12afd tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 2.216760 Jun 21 18:29:57.379619 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 32/57] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:55 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 2223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:57.397360 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5e5555d0-dea2-4f92-8d01-bb532fa458ab tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-526892076", "imageRef": "c28659fb-c2d3-4dda-a330-1323a974987e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "29d4e26f-e314-4e70-8390-44e86b316d90"}], "security_groups": [{"name": "tempest-securitygroup--2086942079"}], "key_name": "tempest-keypair-1916343093", "user_data": "}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:57.422920 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-a4a7049e-1bd8-49c3-996c-c16bd25c77cf req-79e7839e-45d2-453a-baba-2a81acd3903a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f480e87-eeb9-47b0-95b8-f3ef475d2843", "tag": "12b63897-fe8b-4cf4-a023-8abd752eef06"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:29:57.479527 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-a4a7049e-1bd8-49c3-996c-c16bd25c77cf req-79e7839e-45d2-453a-baba-2a81acd3903a service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:57.484256 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-a4a7049e-1bd8-49c3-996c-c16bd25c77cf req-79e7839e-45d2-453a-baba-2a81acd3903a service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:57.556598 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-a4a7049e-1bd8-49c3-996c-c16bd25c77cf req-79e7839e-45d2-453a-baba-2a81acd3903a service nova] Creating event network-changed:12b63897-fe8b-4cf4-a023-8abd752eef06 for instance 9f480e87-eeb9-47b0-95b8-f3ef475d2843 on hv-cinder-84460 Jun 21 18:29:57.575170 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-a4a7049e-1bd8-49c3-996c-c16bd25c77cf req-79e7839e-45d2-453a-baba-2a81acd3903a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193432 Jun 21 18:29:57.576831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 33/58] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:29:58.214298 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.network.neutron [None req-5e5555d0-dea2-4f92-8d01-bb532fa458ab tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] validate_networks() for [('29d4e26f-e314-4e70-8390-44e86b316d90', None, None, None, None, None)] {{(pid=118108) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:29:58.365942 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-120072eb-1c52-4da8-b6c8-dfb515474d94 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:58.368790 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-120072eb-1c52-4da8-b6c8-dfb515474d94 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:58.381618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-120072eb-1c52-4da8-b6c8-dfb515474d94 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:58.383029 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-120072eb-1c52-4da8-b6c8-dfb515474d94 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:58.396311 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-120072eb-1c52-4da8-b6c8-dfb515474d94 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:58.397578 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-120072eb-1c52-4da8-b6c8-dfb515474d94 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:59.113360 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-120072eb-1c52-4da8-b6c8-dfb515474d94 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:29:59.165230 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-120072eb-1c52-4da8-b6c8-dfb515474d94 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.808619 Jun 21 18:29:59.178043 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 34/59] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:58 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:29:59.179218 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=3 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:29:59.180198 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-7b86ebb3-19dd-48ad-b6ed-9736f22a619b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:29:59.181289 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-7b86ebb3-19dd-48ad-b6ed-9736f22a619b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:29:59.215303 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7b86ebb3-19dd-48ad-b6ed-9736f22a619b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:59.216608 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7b86ebb3-19dd-48ad-b6ed-9736f22a619b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:29:59.218604 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7b86ebb3-19dd-48ad-b6ed-9736f22a619b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:29:59.221580 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7b86ebb3-19dd-48ad-b6ed-9736f22a619b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:00.217684 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-7b86ebb3-19dd-48ad-b6ed-9736f22a619b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:00.230153 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-7b86ebb3-19dd-48ad-b6ed-9736f22a619b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 1.057090 Jun 21 18:30:00.230887 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 35/60] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:29:59 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:00.249737 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-18cc1c3c-860b-490b-8bc5-aa1372f075e7 req-05a030e6-440b-4a00-a438-c4d35c43520c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5", "tag": "b9bbbf5a-5964-4d39-9046-b5480e68aa1e"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:00.276335 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-18cc1c3c-860b-490b-8bc5-aa1372f075e7 req-05a030e6-440b-4a00-a438-c4d35c43520c service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:00.277198 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-18cc1c3c-860b-490b-8bc5-aa1372f075e7 req-05a030e6-440b-4a00-a438-c4d35c43520c service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:00.305851 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-18cc1c3c-860b-490b-8bc5-aa1372f075e7 req-05a030e6-440b-4a00-a438-c4d35c43520c service nova] Creating event network-changed:b9bbbf5a-5964-4d39-9046-b5480e68aa1e for instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 on hv-cinder-84460 Jun 21 18:30:00.312208 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-18cc1c3c-860b-490b-8bc5-aa1372f075e7 req-05a030e6-440b-4a00-a438-c4d35c43520c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069963 Jun 21 18:30:00.313824 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 36/61] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:30:00.320945 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-37ed39f7-1d67-4ffb-bd45-ef4ba68eaac6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:00.321998 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-37ed39f7-1d67-4ffb-bd45-ef4ba68eaac6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:00.334846 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-37ed39f7-1d67-4ffb-bd45-ef4ba68eaac6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:00.336787 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-37ed39f7-1d67-4ffb-bd45-ef4ba68eaac6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:00.337677 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-37ed39f7-1d67-4ffb-bd45-ef4ba68eaac6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:00.339902 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-37ed39f7-1d67-4ffb-bd45-ef4ba68eaac6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:01.155714 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-5e5555d0-dea2-4f92-8d01-bb532fa458ab tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Flavor limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:30:01.157046 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-5e5555d0-dea2-4f92-8d01-bb532fa458ab tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Image limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:30:01.158377 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-5e5555d0-dea2-4f92-8d01-bb532fa458ab tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Flavor pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:30:01.159359 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-5e5555d0-dea2-4f92-8d01-bb532fa458ab tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Image pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:30:01.160705 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-5e5555d0-dea2-4f92-8d01-bb532fa458ab tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:30:01.211810 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5e5555d0-dea2-4f92-8d01-bb532fa458ab tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:01.214663 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5e5555d0-dea2-4f92-8d01-bb532fa458ab tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:01.215852 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5e5555d0-dea2-4f92-8d01-bb532fa458ab tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:01.219823 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5e5555d0-dea2-4f92-8d01-bb532fa458ab tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:01.228674 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-37ed39f7-1d67-4ffb-bd45-ef4ba68eaac6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:01.256125 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-37ed39f7-1d67-4ffb-bd45-ef4ba68eaac6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.939554 Jun 21 18:30:01.258276 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 37/62] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:00 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:01.272290 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f04972b7-88bd-4a6b-9854-d3ea32bd7c79 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-850043144", "imageRef": "c28659fb-c2d3-4dda-a330-1323a974987e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3045cac3-4145-4de7-8ebd-18844bcf0906"}], "security_groups": [{"name": "tempest-securitygroup--1459138803"}], "key_name": "tempest-keypair-2010660305", "user_data": "}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:01.356462 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-5e5555d0-dea2-4f92-8d01-bb532fa458ab tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Getting quotas for project 53e2bb9f793041c2aef6e222b76c3961. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:30:01.391124 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-5e5555d0-dea2-4f92-8d01-bb532fa458ab tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Getting quotas for user 144c9c31ed9b469aa200dcb16c89ab4e and project 53e2bb9f793041c2aef6e222b76c3961. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:30:01.476426 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-5e5555d0-dea2-4f92-8d01-bb532fa458ab tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Going to run 1 instances... {{(pid=118108) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:30:01.489511 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-5e5555d0-dea2-4f92-8d01-bb532fa458ab tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c28659fb-c2d3-4dda-a330-1323a974987e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118108) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:30:01.533307 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.network.neutron [None req-f04972b7-88bd-4a6b-9854-d3ea32bd7c79 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] validate_networks() for [('3045cac3-4145-4de7-8ebd-18844bcf0906', None, None, None, None, None)] {{(pid=118109) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:30:01.687423 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-5e5555d0-dea2-4f92-8d01-bb532fa458ab tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.336357 Jun 21 18:30:01.699889 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 26/63] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:29:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 4355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:30:01.717322 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-58f0f6c3-b971-42d8-bf8a-7a65081fb4a4 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:01.726096 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-58f0f6c3-b971-42d8-bf8a-7a65081fb4a4 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:01.774488 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-58f0f6c3-b971-42d8-bf8a-7a65081fb4a4 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:01.777085 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-58f0f6c3-b971-42d8-bf8a-7a65081fb4a4 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:01.784089 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-58f0f6c3-b971-42d8-bf8a-7a65081fb4a4 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:01.785076 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-58f0f6c3-b971-42d8-bf8a-7a65081fb4a4 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:02.490985 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-58f0f6c3-b971-42d8-bf8a-7a65081fb4a4 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:02.523341 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-58f0f6c3-b971-42d8-bf8a-7a65081fb4a4 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 0.818478 Jun 21 18:30:02.526474 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 27/64] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:01 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:02.533739 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-9a57e97d-e597-478d-be6c-c2f2a3c9518e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:02.534567 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-9a57e97d-e597-478d-be6c-c2f2a3c9518e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:03.112319 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-9a57e97d-e597-478d-be6c-c2f2a3c9518e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:03.187907 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-9a57e97d-e597-478d-be6c-c2f2a3c9518e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1241 microversion: 2.1 time: 0.659427 Jun 21 18:30:03.188918 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 28/65] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:02 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1241 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:03.207117 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-11f57a9c-070b-4254-a18d-e98871c20f0a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:03.238603 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-11f57a9c-070b-4254-a18d-e98871c20f0a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:03.275982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-11f57a9c-070b-4254-a18d-e98871c20f0a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:03.279606 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-11f57a9c-070b-4254-a18d-e98871c20f0a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:03.282459 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-11f57a9c-070b-4254-a18d-e98871c20f0a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:03.291496 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-11f57a9c-070b-4254-a18d-e98871c20f0a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:03.822870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-f04972b7-88bd-4a6b-9854-d3ea32bd7c79 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Flavor limits 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:30:03.823690 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-f04972b7-88bd-4a6b-9854-d3ea32bd7c79 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Image limits 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:30:03.824685 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-f04972b7-88bd-4a6b-9854-d3ea32bd7c79 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Flavor pref 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:30:03.825421 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-f04972b7-88bd-4a6b-9854-d3ea32bd7c79 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Image pref 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:30:03.826471 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-f04972b7-88bd-4a6b-9854-d3ea32bd7c79 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:30:03.881309 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f04972b7-88bd-4a6b-9854-d3ea32bd7c79 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:03.894201 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f04972b7-88bd-4a6b-9854-d3ea32bd7c79 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:03.901408 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-11f57a9c-070b-4254-a18d-e98871c20f0a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:03.902684 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f04972b7-88bd-4a6b-9854-d3ea32bd7c79 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:03.903491 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f04972b7-88bd-4a6b-9854-d3ea32bd7c79 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:03.922030 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-11f57a9c-070b-4254-a18d-e98871c20f0a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.726372 Jun 21 18:30:03.923225 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 29/66] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:03 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:03.929185 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-34b92696-a658-4fdc-b902-a2217b43f986 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:03.930212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-34b92696-a658-4fdc-b902-a2217b43f986 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:03.941534 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-34b92696-a658-4fdc-b902-a2217b43f986 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:03.942300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-34b92696-a658-4fdc-b902-a2217b43f986 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:03.943498 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-34b92696-a658-4fdc-b902-a2217b43f986 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:03.944153 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-34b92696-a658-4fdc-b902-a2217b43f986 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:03.958281 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=83 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:04.004529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-f04972b7-88bd-4a6b-9854-d3ea32bd7c79 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Getting quotas for project 3c88935a83d24e408c99cb711ae46257. Resources: {'instances', 'ram', 'cores'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:30:04.038224 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-f04972b7-88bd-4a6b-9854-d3ea32bd7c79 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Getting quotas for user acf9a33e9fb941939010989a89a51d38 and project 3c88935a83d24e408c99cb711ae46257. Resources: {'instances', 'ram', 'cores'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:30:04.064704 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f04972b7-88bd-4a6b-9854-d3ea32bd7c79 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Going to run 1 instances... {{(pid=118109) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:30:04.067758 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f04972b7-88bd-4a6b-9854-d3ea32bd7c79 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c28659fb-c2d3-4dda-a330-1323a974987e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118109) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:30:04.215357 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f04972b7-88bd-4a6b-9854-d3ea32bd7c79 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.952093 Jun 21 18:30:04.217614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 38/67] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:30:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 2958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:30:04.248892 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-50127034-dd78-4e36-af8b-bf7aebd2ac4f tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:04.253462 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-50127034-dd78-4e36-af8b-bf7aebd2ac4f tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:04.280597 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-50127034-dd78-4e36-af8b-bf7aebd2ac4f tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:04.283540 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-50127034-dd78-4e36-af8b-bf7aebd2ac4f tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:04.284891 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-50127034-dd78-4e36-af8b-bf7aebd2ac4f tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:04.285830 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-50127034-dd78-4e36-af8b-bf7aebd2ac4f tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:04.442037 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-34b92696-a658-4fdc-b902-a2217b43f986 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:04.444464 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-50127034-dd78-4e36-af8b-bf7aebd2ac4f tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:04.460326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-50127034-dd78-4e36-af8b-bf7aebd2ac4f tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1293 microversion: 2.1 time: 0.239369 Jun 21 18:30:04.460757 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-34b92696-a658-4fdc-b902-a2217b43f986 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 0.534827 Jun 21 18:30:04.460946 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 39/68] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:04 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1293 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:04.475658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 30/69] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:03 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:04.489431 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-3f4a530f-a83d-4c73-b8aa-4c13dc1fc10c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:04.490715 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-3f4a530f-a83d-4c73-b8aa-4c13dc1fc10c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:04.589334 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-3f4a530f-a83d-4c73-b8aa-4c13dc1fc10c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:04.602824 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-3f4a530f-a83d-4c73-b8aa-4c13dc1fc10c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1237 microversion: 2.1 time: 0.140752 Jun 21 18:30:04.608931 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 40/70] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:04 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1237 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:04.952561 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-19cc6974-4997-4c3f-96ff-17ccc633b09b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:04.954012 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-19cc6974-4997-4c3f-96ff-17ccc633b09b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:04.971434 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-19cc6974-4997-4c3f-96ff-17ccc633b09b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:04.979449 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-19cc6974-4997-4c3f-96ff-17ccc633b09b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:04.983567 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-19cc6974-4997-4c3f-96ff-17ccc633b09b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:04.985678 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-19cc6974-4997-4c3f-96ff-17ccc633b09b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:05.361453 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-19cc6974-4997-4c3f-96ff-17ccc633b09b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:05.380877 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-19cc6974-4997-4c3f-96ff-17ccc633b09b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.436404 Jun 21 18:30:05.392682 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 31/71] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:04 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:05.495404 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-5e0f45f9-fd56-411e-976b-b744f34a25ec tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:05.497928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-5e0f45f9-fd56-411e-976b-b744f34a25ec tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:05.511072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5e0f45f9-fd56-411e-976b-b744f34a25ec tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:05.513335 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5e0f45f9-fd56-411e-976b-b744f34a25ec tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:05.514348 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5e0f45f9-fd56-411e-976b-b744f34a25ec tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:05.515047 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5e0f45f9-fd56-411e-976b-b744f34a25ec tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:05.516638 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-0e377bc9-2d03-4873-bdd1-8e14af021c76 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:05.517774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-0e377bc9-2d03-4873-bdd1-8e14af021c76 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:05.526907 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0e377bc9-2d03-4873-bdd1-8e14af021c76 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:05.527525 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0e377bc9-2d03-4873-bdd1-8e14af021c76 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:05.528511 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0e377bc9-2d03-4873-bdd1-8e14af021c76 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:05.529145 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0e377bc9-2d03-4873-bdd1-8e14af021c76 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:05.712634 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-5e0f45f9-fd56-411e-976b-b744f34a25ec tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:05.727567 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-5e0f45f9-fd56-411e-976b-b744f34a25ec tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1293 microversion: 2.1 time: 0.238204 Jun 21 18:30:05.728973 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 41/72] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:05 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1293 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:05.737931 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-7c545c68-014e-4b3a-809f-66f285e36528 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:05.740760 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-7c545c68-014e-4b3a-809f-66f285e36528 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:05.755919 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7c545c68-014e-4b3a-809f-66f285e36528 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:05.757033 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7c545c68-014e-4b3a-809f-66f285e36528 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:05.758478 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7c545c68-014e-4b3a-809f-66f285e36528 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:05.760157 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7c545c68-014e-4b3a-809f-66f285e36528 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:06.032805 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-7c545c68-014e-4b3a-809f-66f285e36528 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:06.050992 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-7c545c68-014e-4b3a-809f-66f285e36528 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1241 microversion: 2.1 time: 0.319803 Jun 21 18:30:06.052541 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 42/73] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:05 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1241 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:06.213192 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-0e377bc9-2d03-4873-bdd1-8e14af021c76 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:06.244718 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-0e377bc9-2d03-4873-bdd1-8e14af021c76 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 0.745430 Jun 21 18:30:06.246644 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 32/74] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:05 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:06.425488 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-53fd9b68-fdd1-46ff-9d70-b2681cb9505b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:06.430988 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-53fd9b68-fdd1-46ff-9d70-b2681cb9505b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:06.450723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-53fd9b68-fdd1-46ff-9d70-b2681cb9505b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:06.451781 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-53fd9b68-fdd1-46ff-9d70-b2681cb9505b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:06.453465 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-53fd9b68-fdd1-46ff-9d70-b2681cb9505b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:06.454218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-53fd9b68-fdd1-46ff-9d70-b2681cb9505b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:06.762183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-40086969-0a50-4fc9-9180-c04b9d815e3d tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:06.765667 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-40086969-0a50-4fc9-9180-c04b9d815e3d tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:06.798668 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-40086969-0a50-4fc9-9180-c04b9d815e3d tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:06.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-40086969-0a50-4fc9-9180-c04b9d815e3d tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:06.804643 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-40086969-0a50-4fc9-9180-c04b9d815e3d tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:06.805919 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-40086969-0a50-4fc9-9180-c04b9d815e3d tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:06.946306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-53fd9b68-fdd1-46ff-9d70-b2681cb9505b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:06.972524 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-53fd9b68-fdd1-46ff-9d70-b2681cb9505b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.554302 Jun 21 18:30:06.975093 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 43/75] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:06 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:07.055284 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-40086969-0a50-4fc9-9180-c04b9d815e3d tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:07.078403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-27cd3ca9-8129-4e44-9f27-30322c15004b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:07.079539 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-27cd3ca9-8129-4e44-9f27-30322c15004b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:07.106890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-40086969-0a50-4fc9-9180-c04b9d815e3d tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1301 microversion: 2.1 time: 0.352844 Jun 21 18:30:07.109244 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-27cd3ca9-8129-4e44-9f27-30322c15004b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:07.114097 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 33/76] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:06 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1301 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:07.116639 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-27cd3ca9-8129-4e44-9f27-30322c15004b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:07.122814 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-27cd3ca9-8129-4e44-9f27-30322c15004b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:07.127354 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-27cd3ca9-8129-4e44-9f27-30322c15004b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:07.275129 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-845a2817-0870-4cde-900f-c8411f9f777f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:07.275983 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-845a2817-0870-4cde-900f-c8411f9f777f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:07.303490 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-845a2817-0870-4cde-900f-c8411f9f777f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:07.306135 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-845a2817-0870-4cde-900f-c8411f9f777f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:07.309228 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-845a2817-0870-4cde-900f-c8411f9f777f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:07.310440 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-845a2817-0870-4cde-900f-c8411f9f777f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:07.434271 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-27cd3ca9-8129-4e44-9f27-30322c15004b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:07.467359 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-27cd3ca9-8129-4e44-9f27-30322c15004b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1289 microversion: 2.1 time: 0.394150 Jun 21 18:30:07.475690 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 44/77] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:07 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1289 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:08.113190 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-845a2817-0870-4cde-900f-c8411f9f777f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:08.155604 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-845a2817-0870-4cde-900f-c8411f9f777f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 0.885823 Jun 21 18:30:08.157146 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 34/78] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:07 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:08.172779 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-ef9cbf8e-102c-4d3b-9379-3d649deb30db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:08.179059 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-ef9cbf8e-102c-4d3b-9379-3d649deb30db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:08.203347 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef9cbf8e-102c-4d3b-9379-3d649deb30db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:08.213085 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef9cbf8e-102c-4d3b-9379-3d649deb30db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:08.214946 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef9cbf8e-102c-4d3b-9379-3d649deb30db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:08.215973 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef9cbf8e-102c-4d3b-9379-3d649deb30db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:08.543719 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-e33504f9-16f3-4d80-8ba7-ec1186be76e2 req-066383b6-375a-415f-a9c6-2890c5aa8ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3e33553-dc4c-4e34-8533-beea14017592", "name": "network-vif-plugged", "status": "completed", "tag": "d4836e08-d41b-4ef2-b2c0-250ffcd31fdb"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:08.582343 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-e33504f9-16f3-4d80-8ba7-ec1186be76e2 req-066383b6-375a-415f-a9c6-2890c5aa8ec7 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:08.583739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-e33504f9-16f3-4d80-8ba7-ec1186be76e2 req-066383b6-375a-415f-a9c6-2890c5aa8ec7 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:08.623823 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-e33504f9-16f3-4d80-8ba7-ec1186be76e2 req-066383b6-375a-415f-a9c6-2890c5aa8ec7 service nova] Creating event network-vif-plugged:d4836e08-d41b-4ef2-b2c0-250ffcd31fdb for instance c3e33553-dc4c-4e34-8533-beea14017592 on hv-cinder-84460 Jun 21 18:30:08.635177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-e33504f9-16f3-4d80-8ba7-ec1186be76e2 req-066383b6-375a-415f-a9c6-2890c5aa8ec7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.683127 Jun 21 18:30:08.637371 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 45/79] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:30:08.648554 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6fc09bad-19cc-41f0-a83f-bdb3b662f940 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:08.650278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6fc09bad-19cc-41f0-a83f-bdb3b662f940 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:08.668368 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6fc09bad-19cc-41f0-a83f-bdb3b662f940 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:08.669582 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6fc09bad-19cc-41f0-a83f-bdb3b662f940 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:08.670719 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ef9cbf8e-102c-4d3b-9379-3d649deb30db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:08.672364 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6fc09bad-19cc-41f0-a83f-bdb3b662f940 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:08.673811 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6fc09bad-19cc-41f0-a83f-bdb3b662f940 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:08.704363 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-ef9cbf8e-102c-4d3b-9379-3d649deb30db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.545217 Jun 21 18:30:08.705416 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 35/80] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:08 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:08.759200 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-3868b866-3bc6-497a-b913-f567189daa5a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:08.761487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-3868b866-3bc6-497a-b913-f567189daa5a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:08.801821 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3868b866-3bc6-497a-b913-f567189daa5a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:08.803307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3868b866-3bc6-497a-b913-f567189daa5a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:08.809598 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3868b866-3bc6-497a-b913-f567189daa5a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:08.811121 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3868b866-3bc6-497a-b913-f567189daa5a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:08.890977 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-6fc09bad-19cc-41f0-a83f-bdb3b662f940 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:08.960119 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6fc09bad-19cc-41f0-a83f-bdb3b662f940 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1299 microversion: 2.1 time: 0.306314 Jun 21 18:30:08.985556 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 46/81] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:08 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1299 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:09.184738 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-097c058f-70d0-4641-ba77-e16f187443a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:09.190964 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-097c058f-70d0-4641-ba77-e16f187443a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:09.192667 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-3868b866-3bc6-497a-b913-f567189daa5a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:09.231628 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-3868b866-3bc6-497a-b913-f567189daa5a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1295 microversion: 2.1 time: 0.523398 Jun 21 18:30:09.234288 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 36/82] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:08 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1295 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:09.292955 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-097c058f-70d0-4641-ba77-e16f187443a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:09.336677 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-097c058f-70d0-4641-ba77-e16f187443a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:09.347529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-097c058f-70d0-4641-ba77-e16f187443a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:09.351316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-097c058f-70d0-4641-ba77-e16f187443a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:09.742200 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6cfc3c0a-567d-430b-9c85-79041f443b29 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:09.744896 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-6cfc3c0a-567d-430b-9c85-79041f443b29 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:09.766744 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6cfc3c0a-567d-430b-9c85-79041f443b29 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:09.768793 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6cfc3c0a-567d-430b-9c85-79041f443b29 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:09.775899 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6cfc3c0a-567d-430b-9c85-79041f443b29 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:09.777826 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6cfc3c0a-567d-430b-9c85-79041f443b29 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:10.250290 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-097c058f-70d0-4641-ba77-e16f187443a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:10.271905 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-097c058f-70d0-4641-ba77-e16f187443a0 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 1.100354 Jun 21 18:30:10.273896 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 47/83] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:09 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:10.320735 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-70b0ce90-4d64-4001-aab4-6ca33c0e701b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:10.325010 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-70b0ce90-4d64-4001-aab4-6ca33c0e701b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:10.354790 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-70b0ce90-4d64-4001-aab4-6ca33c0e701b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:10.355696 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-70b0ce90-4d64-4001-aab4-6ca33c0e701b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:10.358374 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-70b0ce90-4d64-4001-aab4-6ca33c0e701b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:10.360609 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-70b0ce90-4d64-4001-aab4-6ca33c0e701b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:10.506762 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6cfc3c0a-567d-430b-9c85-79041f443b29 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:10.556396 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6cfc3c0a-567d-430b-9c85-79041f443b29 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.822433 Jun 21 18:30:10.577245 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 37/84] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:09 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:10.590266 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-70b0ce90-4d64-4001-aab4-6ca33c0e701b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:10.592890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-ff7ebf29-5dbc-4242-b17b-1df563b446d2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:10.594186 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-ff7ebf29-5dbc-4242-b17b-1df563b446d2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:10.612799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-70b0ce90-4d64-4001-aab4-6ca33c0e701b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1299 microversion: 2.1 time: 0.335474 Jun 21 18:30:10.614417 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 48/85] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:10 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1299 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:10.618554 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ff7ebf29-5dbc-4242-b17b-1df563b446d2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:10.619361 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ff7ebf29-5dbc-4242-b17b-1df563b446d2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:10.620806 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ff7ebf29-5dbc-4242-b17b-1df563b446d2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:10.626725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ff7ebf29-5dbc-4242-b17b-1df563b446d2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:10.883132 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ff7ebf29-5dbc-4242-b17b-1df563b446d2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:10.947148 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-ff7ebf29-5dbc-4242-b17b-1df563b446d2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1295 microversion: 2.1 time: 0.362300 Jun 21 18:30:10.965566 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 38/86] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:10 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1295 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:11.296968 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ecd32af6-d9e4-4d45-b185-3ffea7649450 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:11.298100 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ecd32af6-d9e4-4d45-b185-3ffea7649450 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:11.307459 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ecd32af6-d9e4-4d45-b185-3ffea7649450 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:11.308399 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ecd32af6-d9e4-4d45-b185-3ffea7649450 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:11.310448 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ecd32af6-d9e4-4d45-b185-3ffea7649450 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:11.311105 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ecd32af6-d9e4-4d45-b185-3ffea7649450 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:11.530402 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ecd32af6-d9e4-4d45-b185-3ffea7649450 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:11.541852 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ecd32af6-d9e4-4d45-b185-3ffea7649450 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 0.248852 Jun 21 18:30:11.552490 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 49/87] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:11 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:11.595552 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-ddd0d25d-6b36-49b8-8c15-937dd3735301 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:11.597441 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-ddd0d25d-6b36-49b8-8c15-937dd3735301 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:11.601202 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=2 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:11.614357 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ddd0d25d-6b36-49b8-8c15-937dd3735301 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:11.615634 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ddd0d25d-6b36-49b8-8c15-937dd3735301 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:11.617476 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ddd0d25d-6b36-49b8-8c15-937dd3735301 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:11.618029 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ddd0d25d-6b36-49b8-8c15-937dd3735301 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:11.642886 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ae5d374c-0c64-4a81-b9a9-558a925a5fd1 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:11.643628 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ae5d374c-0c64-4a81-b9a9-558a925a5fd1 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:11.658103 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ae5d374c-0c64-4a81-b9a9-558a925a5fd1 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:11.659172 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ae5d374c-0c64-4a81-b9a9-558a925a5fd1 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:11.662483 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ae5d374c-0c64-4a81-b9a9-558a925a5fd1 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:11.663265 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ae5d374c-0c64-4a81-b9a9-558a925a5fd1 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:12.128500 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ae5d374c-0c64-4a81-b9a9-558a925a5fd1 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:12.164309 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ae5d374c-0c64-4a81-b9a9-558a925a5fd1 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.523426 Jun 21 18:30:12.180936 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 50/88] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:11 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:12.196563 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bcbba140-0d6b-49b9-80b8-12711d2a3771 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:12.203751 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-bcbba140-0d6b-49b9-80b8-12711d2a3771 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:12.234293 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bcbba140-0d6b-49b9-80b8-12711d2a3771 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:12.235506 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bcbba140-0d6b-49b9-80b8-12711d2a3771 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:12.237284 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bcbba140-0d6b-49b9-80b8-12711d2a3771 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:12.243422 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bcbba140-0d6b-49b9-80b8-12711d2a3771 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:12.277576 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ddd0d25d-6b36-49b8-8c15-937dd3735301 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:12.301012 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-ddd0d25d-6b36-49b8-8c15-937dd3735301 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.713691 Jun 21 18:30:12.302719 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 39/89] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:11 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:12.505601 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-bcbba140-0d6b-49b9-80b8-12711d2a3771 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:12.528593 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-bcbba140-0d6b-49b9-80b8-12711d2a3771 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.345394 Jun 21 18:30:12.540509 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 51/90] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:12 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:12.560603 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e8a87e71-67d5-46d2-84ed-1382daf73270 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:12.561268 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e8a87e71-67d5-46d2-84ed-1382daf73270 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:12.571790 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e8a87e71-67d5-46d2-84ed-1382daf73270 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:12.572230 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e8a87e71-67d5-46d2-84ed-1382daf73270 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:12.575487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e8a87e71-67d5-46d2-84ed-1382daf73270 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:12.575855 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e8a87e71-67d5-46d2-84ed-1382daf73270 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:12.902875 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e8a87e71-67d5-46d2-84ed-1382daf73270 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:12.915144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e8a87e71-67d5-46d2-84ed-1382daf73270 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 0.358852 Jun 21 18:30:12.918657 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 40/91] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:12 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:13.028640 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-b36c5b04-b493-49ac-ac83-cdba292b8e55 req-0811d030-b26b-46a9-81bc-89f3ca3d0dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5", "name": "network-vif-plugged", "status": "completed", "tag": "b9bbbf5a-5964-4d39-9046-b5480e68aa1e"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:13.042001 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-b36c5b04-b493-49ac-ac83-cdba292b8e55 req-0811d030-b26b-46a9-81bc-89f3ca3d0dbe service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:13.042893 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-b36c5b04-b493-49ac-ac83-cdba292b8e55 req-0811d030-b26b-46a9-81bc-89f3ca3d0dbe service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:13.062811 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-b36c5b04-b493-49ac-ac83-cdba292b8e55 req-0811d030-b26b-46a9-81bc-89f3ca3d0dbe service nova] Creating event network-vif-plugged:b9bbbf5a-5964-4d39-9046-b5480e68aa1e for instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 on hv-cinder-84460 Jun 21 18:30:13.072280 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-b36c5b04-b493-49ac-ac83-cdba292b8e55 req-0811d030-b26b-46a9-81bc-89f3ca3d0dbe service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048521 Jun 21 18:30:13.073732 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 52/92] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:30:13.207926 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-0797054b-840d-4fad-b3be-bc3945f8f50a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:13.209071 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-0797054b-840d-4fad-b3be-bc3945f8f50a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:13.223089 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=8 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:13.235761 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0797054b-840d-4fad-b3be-bc3945f8f50a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:13.236903 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0797054b-840d-4fad-b3be-bc3945f8f50a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:13.238790 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0797054b-840d-4fad-b3be-bc3945f8f50a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:13.239560 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0797054b-840d-4fad-b3be-bc3945f8f50a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:13.250396 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=100 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:13.328011 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-32aaf579-252c-4482-9f13-8eaa2cf29a7d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:13.331794 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-32aaf579-252c-4482-9f13-8eaa2cf29a7d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:13.354349 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-32aaf579-252c-4482-9f13-8eaa2cf29a7d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:13.355334 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-32aaf579-252c-4482-9f13-8eaa2cf29a7d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:13.358573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-32aaf579-252c-4482-9f13-8eaa2cf29a7d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:13.361097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-32aaf579-252c-4482-9f13-8eaa2cf29a7d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:13.509228 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-0797054b-840d-4fad-b3be-bc3945f8f50a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:13.537955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-0797054b-840d-4fad-b3be-bc3945f8f50a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.349753 Jun 21 18:30:13.549912 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 41/93] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:13 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:13.556252 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d412ed76-57e9-4c00-84fe-3f172cb0b193 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:13.557198 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-d412ed76-57e9-4c00-84fe-3f172cb0b193 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:13.565806 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d412ed76-57e9-4c00-84fe-3f172cb0b193 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:13.566537 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d412ed76-57e9-4c00-84fe-3f172cb0b193 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:13.567752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d412ed76-57e9-4c00-84fe-3f172cb0b193 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:13.568824 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d412ed76-57e9-4c00-84fe-3f172cb0b193 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:13.741967 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-32aaf579-252c-4482-9f13-8eaa2cf29a7d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:13.753344 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-32aaf579-252c-4482-9f13-8eaa2cf29a7d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.437143 Jun 21 18:30:13.755636 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 53/94] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:13 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:13.922280 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-d412ed76-57e9-4c00-84fe-3f172cb0b193 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:13.939392 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-d412ed76-57e9-4c00-84fe-3f172cb0b193 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.387328 Jun 21 18:30:13.940814 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 42/95] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:13 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:13.957338 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-af42efdd-d378-4e34-8f10-ed94ed2cc42e tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:13.965817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-af42efdd-d378-4e34-8f10-ed94ed2cc42e tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:13.972751 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=2 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:13.986478 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-af42efdd-d378-4e34-8f10-ed94ed2cc42e tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:13.987215 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-af42efdd-d378-4e34-8f10-ed94ed2cc42e tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:13.989241 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-af42efdd-d378-4e34-8f10-ed94ed2cc42e tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:13.990571 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-af42efdd-d378-4e34-8f10-ed94ed2cc42e tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:14.239086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-af42efdd-d378-4e34-8f10-ed94ed2cc42e tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:14.255768 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-af42efdd-d378-4e34-8f10-ed94ed2cc42e tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 0.307904 Jun 21 18:30:14.256963 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 54/96] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:13 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:14.578481 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-665bde54-4202-44da-81c1-7d644cd991cd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:14.579713 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-665bde54-4202-44da-81c1-7d644cd991cd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:14.598293 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-665bde54-4202-44da-81c1-7d644cd991cd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:14.599851 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-665bde54-4202-44da-81c1-7d644cd991cd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:14.601546 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-665bde54-4202-44da-81c1-7d644cd991cd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:14.602675 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-665bde54-4202-44da-81c1-7d644cd991cd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:14.796015 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b94331a6-2abe-45fa-93fa-8933e9d08847 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:14.797787 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b94331a6-2abe-45fa-93fa-8933e9d08847 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:14.802104 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=8 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:14.814849 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b94331a6-2abe-45fa-93fa-8933e9d08847 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:14.815715 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b94331a6-2abe-45fa-93fa-8933e9d08847 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:14.828067 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b94331a6-2abe-45fa-93fa-8933e9d08847 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:14.829264 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b94331a6-2abe-45fa-93fa-8933e9d08847 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:15.091047 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-665bde54-4202-44da-81c1-7d644cd991cd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:15.127285 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-665bde54-4202-44da-81c1-7d644cd991cd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.568434 Jun 21 18:30:15.128972 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 43/97] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:14 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:15.152561 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-71483860-8f97-4096-ae4d-2cee8b06c1de tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:15.152561 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-71483860-8f97-4096-ae4d-2cee8b06c1de tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:15.185214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-71483860-8f97-4096-ae4d-2cee8b06c1de tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:15.185688 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-71483860-8f97-4096-ae4d-2cee8b06c1de tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:15.186702 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-71483860-8f97-4096-ae4d-2cee8b06c1de tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:15.187779 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-71483860-8f97-4096-ae4d-2cee8b06c1de tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:15.259197 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b94331a6-2abe-45fa-93fa-8933e9d08847 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:15.270952 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b94331a6-2abe-45fa-93fa-8933e9d08847 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.493615 Jun 21 18:30:15.285503 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 55/98] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:14 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:15.301409 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-72ebc4bd-a9b2-451a-9bb5-dfa601915520 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:15.302918 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-72ebc4bd-a9b2-451a-9bb5-dfa601915520 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:15.334361 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-72ebc4bd-a9b2-451a-9bb5-dfa601915520 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:15.335662 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-72ebc4bd-a9b2-451a-9bb5-dfa601915520 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:15.337208 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-72ebc4bd-a9b2-451a-9bb5-dfa601915520 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:15.338198 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-72ebc4bd-a9b2-451a-9bb5-dfa601915520 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:15.598241 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-71483860-8f97-4096-ae4d-2cee8b06c1de tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:15.629824 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-71483860-8f97-4096-ae4d-2cee8b06c1de tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.478894 Jun 21 18:30:15.631311 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 44/99] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:15 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:15.743490 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-72ebc4bd-a9b2-451a-9bb5-dfa601915520 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:15.757990 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-72ebc4bd-a9b2-451a-9bb5-dfa601915520 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 0.469515 Jun 21 18:30:15.758823 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 56/100] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:15 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:16.157486 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d7ea5267-8635-4766-b970-02ac0cc50d6c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:16.158556 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-d7ea5267-8635-4766-b970-02ac0cc50d6c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:16.170376 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d7ea5267-8635-4766-b970-02ac0cc50d6c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:16.170993 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d7ea5267-8635-4766-b970-02ac0cc50d6c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:16.173147 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d7ea5267-8635-4766-b970-02ac0cc50d6c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:16.174013 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d7ea5267-8635-4766-b970-02ac0cc50d6c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:16.294831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-4b6c64ad-696d-4e56-9dbc-8975688bc245 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:16.295459 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-4b6c64ad-696d-4e56-9dbc-8975688bc245 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:16.306852 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4b6c64ad-696d-4e56-9dbc-8975688bc245 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:16.307962 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4b6c64ad-696d-4e56-9dbc-8975688bc245 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:16.309684 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4b6c64ad-696d-4e56-9dbc-8975688bc245 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:16.310440 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4b6c64ad-696d-4e56-9dbc-8975688bc245 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:16.512902 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-d7ea5267-8635-4766-b970-02ac0cc50d6c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:16.528183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-d7ea5267-8635-4766-b970-02ac0cc50d6c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.378699 Jun 21 18:30:16.529057 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 45/101] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:16 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:16.580982 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-4b6c64ad-696d-4e56-9dbc-8975688bc245 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:16.583461 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=100 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:16.591260 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-4b6c64ad-696d-4e56-9dbc-8975688bc245 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.299987 Jun 21 18:30:16.591992 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 57/102] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:16 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:16.658438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d7e34bff-410d-4906-8a5a-e83a351c8c5e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:16.659070 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-d7e34bff-410d-4906-8a5a-e83a351c8c5e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:16.672260 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d7e34bff-410d-4906-8a5a-e83a351c8c5e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:16.672899 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d7e34bff-410d-4906-8a5a-e83a351c8c5e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:16.673739 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d7e34bff-410d-4906-8a5a-e83a351c8c5e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:16.674174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d7e34bff-410d-4906-8a5a-e83a351c8c5e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:16.787513 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-263c5846-ca44-4c4d-a811-dbde1bf83550 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:16.789056 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-263c5846-ca44-4c4d-a811-dbde1bf83550 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:16.805680 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-263c5846-ca44-4c4d-a811-dbde1bf83550 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:16.806496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-263c5846-ca44-4c4d-a811-dbde1bf83550 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:16.808804 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-263c5846-ca44-4c4d-a811-dbde1bf83550 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:16.809885 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-263c5846-ca44-4c4d-a811-dbde1bf83550 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:16.972661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-d7e34bff-410d-4906-8a5a-e83a351c8c5e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:16.991687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-d7e34bff-410d-4906-8a5a-e83a351c8c5e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.341988 Jun 21 18:30:16.993146 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 46/103] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:16 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:17.067305 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-263c5846-ca44-4c4d-a811-dbde1bf83550 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:17.076674 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-263c5846-ca44-4c4d-a811-dbde1bf83550 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 0.297928 Jun 21 18:30:17.077886 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 58/104] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:16 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:17.552266 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a99df2ba-e64c-4aff-a784-bc98fe4fa409 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:17.552999 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-a99df2ba-e64c-4aff-a784-bc98fe4fa409 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:17.568365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a99df2ba-e64c-4aff-a784-bc98fe4fa409 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:17.569195 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a99df2ba-e64c-4aff-a784-bc98fe4fa409 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:17.572627 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a99df2ba-e64c-4aff-a784-bc98fe4fa409 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:17.573410 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a99df2ba-e64c-4aff-a784-bc98fe4fa409 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:17.617310 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e7813710-c89e-4386-9928-e6a5376009e6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:17.619595 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e7813710-c89e-4386-9928-e6a5376009e6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:17.628095 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e7813710-c89e-4386-9928-e6a5376009e6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:17.628920 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e7813710-c89e-4386-9928-e6a5376009e6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:17.630318 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e7813710-c89e-4386-9928-e6a5376009e6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:17.631137 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e7813710-c89e-4386-9928-e6a5376009e6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:17.962720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-a99df2ba-e64c-4aff-a784-bc98fe4fa409 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:17.983967 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a99df2ba-e64c-4aff-a784-bc98fe4fa409 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.435360 Jun 21 18:30:17.986569 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 47/105] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:17 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:17.995388 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e7813710-c89e-4386-9928-e6a5376009e6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:18.015194 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e7813710-c89e-4386-9928-e6a5376009e6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.405242 Jun 21 18:30:18.019919 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e03b1fd0-720a-4a7f-9802-0d44338e77a9 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:18.021529 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e03b1fd0-720a-4a7f-9802-0d44338e77a9 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:18.026343 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 59/106] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:17 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:18.035252 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e03b1fd0-720a-4a7f-9802-0d44338e77a9 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:18.036052 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e03b1fd0-720a-4a7f-9802-0d44338e77a9 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:18.037539 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e03b1fd0-720a-4a7f-9802-0d44338e77a9 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:18.038544 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e03b1fd0-720a-4a7f-9802-0d44338e77a9 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:18.103798 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-be1cba60-d2b4-4ecd-84c1-3e556757aeff tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:18.104852 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-be1cba60-d2b4-4ecd-84c1-3e556757aeff tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:18.116054 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-be1cba60-d2b4-4ecd-84c1-3e556757aeff tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:18.117087 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-be1cba60-d2b4-4ecd-84c1-3e556757aeff tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:18.118723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-be1cba60-d2b4-4ecd-84c1-3e556757aeff tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:18.119398 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-be1cba60-d2b4-4ecd-84c1-3e556757aeff tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:18.321001 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e03b1fd0-720a-4a7f-9802-0d44338e77a9 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:18.335479 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e03b1fd0-720a-4a7f-9802-0d44338e77a9 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.324616 Jun 21 18:30:18.346983 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 48/107] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:18 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:18.404076 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-be1cba60-d2b4-4ecd-84c1-3e556757aeff tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:18.430116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-be1cba60-d2b4-4ecd-84c1-3e556757aeff tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 0.332292 Jun 21 18:30:18.431678 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 60/108] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:18 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:19.008685 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-03b7767f-1b80-405a-9944-98d0a771cf05 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:19.009606 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-03b7767f-1b80-405a-9944-98d0a771cf05 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:19.017500 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-03b7767f-1b80-405a-9944-98d0a771cf05 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:19.018280 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-03b7767f-1b80-405a-9944-98d0a771cf05 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:19.019301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-03b7767f-1b80-405a-9944-98d0a771cf05 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:19.020272 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-03b7767f-1b80-405a-9944-98d0a771cf05 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:19.046806 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-75382b40-2697-47e5-8b1c-172bc96a3488 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:19.050019 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-75382b40-2697-47e5-8b1c-172bc96a3488 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:19.067661 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-75382b40-2697-47e5-8b1c-172bc96a3488 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:19.069145 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-75382b40-2697-47e5-8b1c-172bc96a3488 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:19.071427 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-75382b40-2697-47e5-8b1c-172bc96a3488 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:19.072569 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-75382b40-2697-47e5-8b1c-172bc96a3488 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:19.338769 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-03b7767f-1b80-405a-9944-98d0a771cf05 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:19.351598 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-03b7767f-1b80-405a-9944-98d0a771cf05 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.349965 Jun 21 18:30:19.370466 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 49/109] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:18 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:19.381335 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-4e80fcb8-3a34-4ff1-ba40-d3f3b0fe66be req-0d51999e-eccc-470e-b7f0-ec8789619fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e", "tag": "0c04c020-626c-4450-aa54-6781ab086cee"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:19.404423 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:19.408067 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-4e80fcb8-3a34-4ff1-ba40-d3f3b0fe66be req-0d51999e-eccc-470e-b7f0-ec8789619fb1 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:19.409162 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-4e80fcb8-3a34-4ff1-ba40-d3f3b0fe66be req-0d51999e-eccc-470e-b7f0-ec8789619fb1 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:19.447304 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-75382b40-2697-47e5-8b1c-172bc96a3488 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:19.461221 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-4e80fcb8-3a34-4ff1-ba40-d3f3b0fe66be req-0d51999e-eccc-470e-b7f0-ec8789619fb1 service nova] Creating event network-changed:0c04c020-626c-4450-aa54-6781ab086cee for instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e on hv-cinder-84460 Jun 21 18:30:19.463204 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-4e80fcb8-3a34-4ff1-ba40-d3f3b0fe66be req-0d51999e-eccc-470e-b7f0-ec8789619fb1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118108) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 18:30:19.465562 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b8e50b10-4c7c-49de-beda-7e29783106e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:19.466420 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b8e50b10-4c7c-49de-beda-7e29783106e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:19.467852 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b8e50b10-4c7c-49de-beda-7e29783106e6 None None] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:19.468989 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b8e50b10-4c7c-49de-beda-7e29783106e6 None None] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:19.472111 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-75382b40-2697-47e5-8b1c-172bc96a3488 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.432629 Jun 21 18:30:19.473136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 61/110] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:19 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:19.493354 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.compute.rpcapi [None req-b8e50b10-4c7c-49de-beda-7e29783106e6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 18:30:19.496168 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b8e50b10-4c7c-49de-beda-7e29783106e6 None None] Releasing lock "compute-rpcapi-router" {{(pid=118108) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 18:30:19.499955 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-52febedc-f463-475e-a22e-42111ae7ab31 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:19.501161 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-52febedc-f463-475e-a22e-42111ae7ab31 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:19.519577 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-52febedc-f463-475e-a22e-42111ae7ab31 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:19.520476 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-52febedc-f463-475e-a22e-42111ae7ab31 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:19.521965 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-52febedc-f463-475e-a22e-42111ae7ab31 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:19.522761 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-52febedc-f463-475e-a22e-42111ae7ab31 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:19.543436 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b8e50b10-4c7c-49de-beda-7e29783106e6 None None] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171079 Jun 21 18:30:19.545057 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 50/111] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:30:19.562703 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-837ee767-f240-4654-9bd3-b3af1f9e9ead tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:19.572340 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-837ee767-f240-4654-9bd3-b3af1f9e9ead tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:19.585935 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-837ee767-f240-4654-9bd3-b3af1f9e9ead tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:19.586535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-837ee767-f240-4654-9bd3-b3af1f9e9ead tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:19.588351 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-837ee767-f240-4654-9bd3-b3af1f9e9ead tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:19.589486 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-837ee767-f240-4654-9bd3-b3af1f9e9ead tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:19.944905 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-52febedc-f463-475e-a22e-42111ae7ab31 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:19.954710 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-52febedc-f463-475e-a22e-42111ae7ab31 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.476981 Jun 21 18:30:19.955695 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 62/112] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:19 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:19.966476 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-837ee767-f240-4654-9bd3-b3af1f9e9ead tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:19.976313 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-837ee767-f240-4654-9bd3-b3af1f9e9ead tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 0.424729 Jun 21 18:30:19.976982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 51/113] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:19 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:20.387616 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6e663170-252e-4ce4-8a5e-3f5c00051365 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:20.388899 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6e663170-252e-4ce4-8a5e-3f5c00051365 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:20.399692 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6e663170-252e-4ce4-8a5e-3f5c00051365 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:20.400483 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6e663170-252e-4ce4-8a5e-3f5c00051365 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:20.402185 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6e663170-252e-4ce4-8a5e-3f5c00051365 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:20.402993 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6e663170-252e-4ce4-8a5e-3f5c00051365 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:20.503199 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-827f44ab-37de-4be1-8866-5e0c37133c4b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:20.505231 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-827f44ab-37de-4be1-8866-5e0c37133c4b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:20.517805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-827f44ab-37de-4be1-8866-5e0c37133c4b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:20.518600 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-827f44ab-37de-4be1-8866-5e0c37133c4b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:20.520154 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-827f44ab-37de-4be1-8866-5e0c37133c4b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:20.521491 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-827f44ab-37de-4be1-8866-5e0c37133c4b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:20.708840 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-6e663170-252e-4ce4-8a5e-3f5c00051365 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:20.723383 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6e663170-252e-4ce4-8a5e-3f5c00051365 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.343303 Jun 21 18:30:20.724458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 63/114] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:20 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:20.977703 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-28a06c3b-e229-40f4-9895-e81d0686419b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:20.979137 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-28a06c3b-e229-40f4-9895-e81d0686419b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:20.990326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-28a06c3b-e229-40f4-9895-e81d0686419b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:20.991194 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-28a06c3b-e229-40f4-9895-e81d0686419b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:20.992694 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-28a06c3b-e229-40f4-9895-e81d0686419b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:20.993540 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-28a06c3b-e229-40f4-9895-e81d0686419b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:21.006237 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-827f44ab-37de-4be1-8866-5e0c37133c4b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:21.020132 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-827f44ab-37de-4be1-8866-5e0c37133c4b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.524943 Jun 21 18:30:21.021188 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 52/115] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:20 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:21.031837 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-81e3f4d9-8e5a-4a1a-84fb-aa4b49e15a87 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:21.031837 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-81e3f4d9-8e5a-4a1a-84fb-aa4b49e15a87 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:21.042774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-81e3f4d9-8e5a-4a1a-84fb-aa4b49e15a87 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:21.043549 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-81e3f4d9-8e5a-4a1a-84fb-aa4b49e15a87 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:21.044923 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-81e3f4d9-8e5a-4a1a-84fb-aa4b49e15a87 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:21.045675 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-81e3f4d9-8e5a-4a1a-84fb-aa4b49e15a87 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:21.293508 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-28a06c3b-e229-40f4-9895-e81d0686419b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:21.310961 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-28a06c3b-e229-40f4-9895-e81d0686419b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.339861 Jun 21 18:30:21.312242 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 64/116] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:20 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:21.325895 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-81e3f4d9-8e5a-4a1a-84fb-aa4b49e15a87 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:21.340261 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-81e3f4d9-8e5a-4a1a-84fb-aa4b49e15a87 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 0.317298 Jun 21 18:30:21.341121 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 53/117] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:21 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:21.576008 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-11310c53-ee51-4417-8cce-b6f21e925f49 req-bcd37575-2a18-4160-bf31-699d85facb71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9d70a7-2f59-4922-a22c-14fe01056ae4", "tag": "8a1f2f86-cb5f-43ed-b726-88cd6b15b327"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:21.585306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-11310c53-ee51-4417-8cce-b6f21e925f49 req-bcd37575-2a18-4160-bf31-699d85facb71 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:21.585773 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-11310c53-ee51-4417-8cce-b6f21e925f49 req-bcd37575-2a18-4160-bf31-699d85facb71 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:21.598674 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-11310c53-ee51-4417-8cce-b6f21e925f49 req-bcd37575-2a18-4160-bf31-699d85facb71 service nova] Creating event network-changed:8a1f2f86-cb5f-43ed-b726-88cd6b15b327 for instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 on hv-cinder-84460 Jun 21 18:30:21.604249 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-11310c53-ee51-4417-8cce-b6f21e925f49 req-bcd37575-2a18-4160-bf31-699d85facb71 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032703 Jun 21 18:30:21.605121 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 65/118] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:30:21.754852 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4238f5a5-1e9a-48cb-89f2-29f09dc22e39 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:21.755936 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4238f5a5-1e9a-48cb-89f2-29f09dc22e39 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:21.768616 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4238f5a5-1e9a-48cb-89f2-29f09dc22e39 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:21.769555 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4238f5a5-1e9a-48cb-89f2-29f09dc22e39 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:21.770945 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4238f5a5-1e9a-48cb-89f2-29f09dc22e39 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:21.771717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4238f5a5-1e9a-48cb-89f2-29f09dc22e39 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:21.995119 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-4238f5a5-1e9a-48cb-89f2-29f09dc22e39 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:22.010314 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4238f5a5-1e9a-48cb-89f2-29f09dc22e39 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.262579 Jun 21 18:30:22.011853 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 54/119] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:21 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:22.040896 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-d2e90725-4842-4cc5-85ae-c49eca42151a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:22.041687 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-d2e90725-4842-4cc5-85ae-c49eca42151a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:22.050117 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d2e90725-4842-4cc5-85ae-c49eca42151a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:22.050635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d2e90725-4842-4cc5-85ae-c49eca42151a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:22.051461 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d2e90725-4842-4cc5-85ae-c49eca42151a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:22.051950 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d2e90725-4842-4cc5-85ae-c49eca42151a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:22.222724 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-d2e90725-4842-4cc5-85ae-c49eca42151a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:22.236327 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-d2e90725-4842-4cc5-85ae-c49eca42151a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.199225 Jun 21 18:30:22.237786 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 66/120] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:22 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:22.341430 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-57fcb02f-ac3c-44aa-9c82-1698a4be7dc1 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:22.343682 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-57fcb02f-ac3c-44aa-9c82-1698a4be7dc1 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:22.358109 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-57fcb02f-ac3c-44aa-9c82-1698a4be7dc1 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:22.359018 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-57fcb02f-ac3c-44aa-9c82-1698a4be7dc1 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:22.361015 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-57fcb02f-ac3c-44aa-9c82-1698a4be7dc1 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:22.361899 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-57fcb02f-ac3c-44aa-9c82-1698a4be7dc1 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:22.370009 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-7c0987ff-2158-4c84-b580-6a67e271be4a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:22.372662 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-7c0987ff-2158-4c84-b580-6a67e271be4a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:22.400762 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7c0987ff-2158-4c84-b580-6a67e271be4a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:22.401438 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7c0987ff-2158-4c84-b580-6a67e271be4a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:22.402640 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7c0987ff-2158-4c84-b580-6a67e271be4a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:22.403163 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7c0987ff-2158-4c84-b580-6a67e271be4a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:22.705037 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-57fcb02f-ac3c-44aa-9c82-1698a4be7dc1 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:22.736200 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-57fcb02f-ac3c-44aa-9c82-1698a4be7dc1 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.403774 Jun 21 18:30:22.737542 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 55/121] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:22 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:22.738960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-7c0987ff-2158-4c84-b580-6a67e271be4a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:22.755236 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-7c0987ff-2158-4c84-b580-6a67e271be4a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 0.399054 Jun 21 18:30:22.756476 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 67/122] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:22 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:23.037391 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b0c382a9-8a35-480d-9383-354995342388 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:23.038968 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b0c382a9-8a35-480d-9383-354995342388 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:23.051118 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b0c382a9-8a35-480d-9383-354995342388 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:23.052606 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b0c382a9-8a35-480d-9383-354995342388 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:23.053973 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b0c382a9-8a35-480d-9383-354995342388 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:23.054938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b0c382a9-8a35-480d-9383-354995342388 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:23.258008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-b0c382a9-8a35-480d-9383-354995342388 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:23.261608 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f7aaa46a-3b55-41e4-b5f8-206387616a5b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:23.263271 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f7aaa46a-3b55-41e4-b5f8-206387616a5b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:23.277680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b0c382a9-8a35-480d-9383-354995342388 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.248294 Jun 21 18:30:23.277918 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7aaa46a-3b55-41e4-b5f8-206387616a5b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:23.279156 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7aaa46a-3b55-41e4-b5f8-206387616a5b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:23.281213 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7aaa46a-3b55-41e4-b5f8-206387616a5b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:23.282495 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7aaa46a-3b55-41e4-b5f8-206387616a5b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:23.289148 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 56/123] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:23 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:23.531887 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f7aaa46a-3b55-41e4-b5f8-206387616a5b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:23.548782 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f7aaa46a-3b55-41e4-b5f8-206387616a5b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.295865 Jun 21 18:30:23.566843 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 68/124] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:23 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:23.665495 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-97000d4b-82a9-495b-8616-24a8be500aa6 req-8693802e-75c7-4b03-b3cb-9b7f34385ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f480e87-eeb9-47b0-95b8-f3ef475d2843", "name": "network-vif-plugged", "status": "completed", "tag": "12b63897-fe8b-4cf4-a023-8abd752eef06"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:23.690792 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-97000d4b-82a9-495b-8616-24a8be500aa6 req-8693802e-75c7-4b03-b3cb-9b7f34385ef2 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:23.694204 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-97000d4b-82a9-495b-8616-24a8be500aa6 req-8693802e-75c7-4b03-b3cb-9b7f34385ef2 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:23.740433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-97000d4b-82a9-495b-8616-24a8be500aa6 req-8693802e-75c7-4b03-b3cb-9b7f34385ef2 service nova] Creating event network-vif-plugged:12b63897-fe8b-4cf4-a023-8abd752eef06 for instance 9f480e87-eeb9-47b0-95b8-f3ef475d2843 on hv-cinder-84460 Jun 21 18:30:23.764534 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b3b9f827-4100-4686-825d-8f84195b9172 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:23.765487 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b3b9f827-4100-4686-825d-8f84195b9172 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:23.774872 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b3b9f827-4100-4686-825d-8f84195b9172 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:23.776409 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b3b9f827-4100-4686-825d-8f84195b9172 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:23.777357 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-97000d4b-82a9-495b-8616-24a8be500aa6 req-8693802e-75c7-4b03-b3cb-9b7f34385ef2 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116349 Jun 21 18:30:23.778744 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 57/125] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:30:23.793313 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b081984b-e32a-4217-94e9-ee9f2dbc0f30 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:23.795264 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b081984b-e32a-4217-94e9-ee9f2dbc0f30 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:23.795503 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b3b9f827-4100-4686-825d-8f84195b9172 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:23.796883 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b3b9f827-4100-4686-825d-8f84195b9172 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:23.826947 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b081984b-e32a-4217-94e9-ee9f2dbc0f30 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:23.829201 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b081984b-e32a-4217-94e9-ee9f2dbc0f30 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:23.831062 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b081984b-e32a-4217-94e9-ee9f2dbc0f30 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:23.839922 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b081984b-e32a-4217-94e9-ee9f2dbc0f30 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:24.188339 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b3b9f827-4100-4686-825d-8f84195b9172 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:24.205163 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b3b9f827-4100-4686-825d-8f84195b9172 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.445670 Jun 21 18:30:24.214694 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 69/126] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:23 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:24.277938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-b081984b-e32a-4217-94e9-ee9f2dbc0f30 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:24.280493 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=100 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:24.292009 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b081984b-e32a-4217-94e9-ee9f2dbc0f30 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 0.507769 Jun 21 18:30:24.292009 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 58/127] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:23 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:24.308671 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-9063f298-0e39-4c3c-905e-3b9007ee4a88 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:24.316086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-9063f298-0e39-4c3c-905e-3b9007ee4a88 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:24.324325 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9063f298-0e39-4c3c-905e-3b9007ee4a88 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:24.325003 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9063f298-0e39-4c3c-905e-3b9007ee4a88 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:24.328303 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9063f298-0e39-4c3c-905e-3b9007ee4a88 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:24.328684 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9063f298-0e39-4c3c-905e-3b9007ee4a88 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:24.581814 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e659f2a1-6b6f-49ec-adb4-7f503dd4658a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:24.585297 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e659f2a1-6b6f-49ec-adb4-7f503dd4658a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:24.596524 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e659f2a1-6b6f-49ec-adb4-7f503dd4658a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:24.597191 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e659f2a1-6b6f-49ec-adb4-7f503dd4658a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:24.598523 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e659f2a1-6b6f-49ec-adb4-7f503dd4658a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:24.599719 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e659f2a1-6b6f-49ec-adb4-7f503dd4658a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:24.616235 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-9063f298-0e39-4c3c-905e-3b9007ee4a88 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:24.641786 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-9063f298-0e39-4c3c-905e-3b9007ee4a88 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.346650 Jun 21 18:30:24.646253 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 70/128] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:24 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:25.034217 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e659f2a1-6b6f-49ec-adb4-7f503dd4658a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:25.054031 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e659f2a1-6b6f-49ec-adb4-7f503dd4658a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.479356 Jun 21 18:30:25.056617 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 59/129] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:24 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:25.235382 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-20b4129b-ec37-4a25-b3f2-497444094a1b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:25.236561 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-20b4129b-ec37-4a25-b3f2-497444094a1b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:25.240802 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:25.248890 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-20b4129b-ec37-4a25-b3f2-497444094a1b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:25.249679 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-20b4129b-ec37-4a25-b3f2-497444094a1b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:25.251185 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-20b4129b-ec37-4a25-b3f2-497444094a1b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:25.251911 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-20b4129b-ec37-4a25-b3f2-497444094a1b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:25.320558 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-3415183d-e32b-448e-bb45-9af18d00b9d2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:25.322905 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-3415183d-e32b-448e-bb45-9af18d00b9d2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:25.342605 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3415183d-e32b-448e-bb45-9af18d00b9d2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:25.344022 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3415183d-e32b-448e-bb45-9af18d00b9d2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:25.345934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3415183d-e32b-448e-bb45-9af18d00b9d2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:25.346928 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3415183d-e32b-448e-bb45-9af18d00b9d2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:25.654712 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-20b4129b-ec37-4a25-b3f2-497444094a1b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:25.679945 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-20b4129b-ec37-4a25-b3f2-497444094a1b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.449793 Jun 21 18:30:25.693945 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 71/130] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:25 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:25.693945 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-aadb74a6-d644-4029-b690-081172344d61 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:25.693945 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-aadb74a6-d644-4029-b690-081172344d61 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:25.715743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aadb74a6-d644-4029-b690-081172344d61 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:25.719918 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aadb74a6-d644-4029-b690-081172344d61 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:25.724727 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aadb74a6-d644-4029-b690-081172344d61 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:25.728499 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aadb74a6-d644-4029-b690-081172344d61 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:26.095848 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-3415183d-e32b-448e-bb45-9af18d00b9d2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:26.118184 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-3415183d-e32b-448e-bb45-9af18d00b9d2 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1315 microversion: 2.1 time: 0.809981 Jun 21 18:30:26.128205 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 60/131] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:25 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1315 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:26.152690 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f6db5dc1-3305-4d5d-8d0c-92d3a4441a49 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:26.153539 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f6db5dc1-3305-4d5d-8d0c-92d3a4441a49 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:26.163992 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f6db5dc1-3305-4d5d-8d0c-92d3a4441a49 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:26.166074 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f6db5dc1-3305-4d5d-8d0c-92d3a4441a49 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:26.167148 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f6db5dc1-3305-4d5d-8d0c-92d3a4441a49 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:26.168078 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f6db5dc1-3305-4d5d-8d0c-92d3a4441a49 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:26.438083 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-aadb74a6-d644-4029-b690-081172344d61 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:26.453749 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-aadb74a6-d644-4029-b690-081172344d61 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.770140 Jun 21 18:30:26.469394 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 72/132] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:25 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:26.703418 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f6db5dc1-3305-4d5d-8d0c-92d3a4441a49 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:26.711955 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-dfd688b4-257b-489a-a867-b827b096fe03 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:26.713487 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-dfd688b4-257b-489a-a867-b827b096fe03 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:26.727900 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f6db5dc1-3305-4d5d-8d0c-92d3a4441a49 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.591282 Jun 21 18:30:26.728189 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 61/133] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:26 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:26.732695 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-dfd688b4-257b-489a-a867-b827b096fe03 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:26.734538 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-dfd688b4-257b-489a-a867-b827b096fe03 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:26.736062 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-dfd688b4-257b-489a-a867-b827b096fe03 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:26.736812 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-dfd688b4-257b-489a-a867-b827b096fe03 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:27.143162 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d4b9c298-dbcc-4066-92a3-9ef25baa8886 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:27.143791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-d4b9c298-dbcc-4066-92a3-9ef25baa8886 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:27.159388 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d4b9c298-dbcc-4066-92a3-9ef25baa8886 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:27.161214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d4b9c298-dbcc-4066-92a3-9ef25baa8886 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:27.162305 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d4b9c298-dbcc-4066-92a3-9ef25baa8886 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:27.163754 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d4b9c298-dbcc-4066-92a3-9ef25baa8886 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:27.188870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-dfd688b4-257b-489a-a867-b827b096fe03 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:27.200235 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-dfd688b4-257b-489a-a867-b827b096fe03 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.498811 Jun 21 18:30:27.201309 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 73/134] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:26 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:27.435134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-d4b9c298-dbcc-4066-92a3-9ef25baa8886 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:27.454064 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-d4b9c298-dbcc-4066-92a3-9ef25baa8886 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1501 microversion: 2.1 time: 0.314909 Jun 21 18:30:27.455367 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 62/135] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:27 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1501 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:27.485051 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-66a9599d-bc65-4884-aab7-cd55c058ee35 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:27.487720 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-66a9599d-bc65-4884-aab7-cd55c058ee35 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:27.500925 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-66a9599d-bc65-4884-aab7-cd55c058ee35 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:27.501982 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-66a9599d-bc65-4884-aab7-cd55c058ee35 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:27.504058 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-66a9599d-bc65-4884-aab7-cd55c058ee35 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:27.505933 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-66a9599d-bc65-4884-aab7-cd55c058ee35 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:27.758951 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-acc809e1-e0ea-44c6-9746-d23f85e4ff40 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:27.762934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-acc809e1-e0ea-44c6-9746-d23f85e4ff40 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:27.789334 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-acc809e1-e0ea-44c6-9746-d23f85e4ff40 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:27.792633 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-acc809e1-e0ea-44c6-9746-d23f85e4ff40 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:27.799682 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-acc809e1-e0ea-44c6-9746-d23f85e4ff40 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:27.800737 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-acc809e1-e0ea-44c6-9746-d23f85e4ff40 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:27.926298 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-66a9599d-bc65-4884-aab7-cd55c058ee35 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:27.943279 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-66a9599d-bc65-4884-aab7-cd55c058ee35 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.466156 Jun 21 18:30:27.945676 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 74/136] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:27 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:28.244149 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-4a42c727-eb7e-4333-bdca-3870ddfd128a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:28.251375 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-4a42c727-eb7e-4333-bdca-3870ddfd128a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:28.347656 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4a42c727-eb7e-4333-bdca-3870ddfd128a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:28.362098 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4a42c727-eb7e-4333-bdca-3870ddfd128a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:28.371097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4a42c727-eb7e-4333-bdca-3870ddfd128a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:28.372546 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4a42c727-eb7e-4333-bdca-3870ddfd128a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:28.472467 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=100 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:28.556660 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-acc809e1-e0ea-44c6-9746-d23f85e4ff40 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:28.592470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-acc809e1-e0ea-44c6-9746-d23f85e4ff40 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1321 microversion: 2.1 time: 0.842344 Jun 21 18:30:28.596259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 63/137] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:27 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1321 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:28.955118 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-4a42c727-eb7e-4333-bdca-3870ddfd128a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:28.972261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-4a42c727-eb7e-4333-bdca-3870ddfd128a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.745337 Jun 21 18:30:28.973750 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 75/138] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:28 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:28.987575 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5e4855d4-9230-41a7-a720-29eba5cd15fb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:28.990013 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-5e4855d4-9230-41a7-a720-29eba5cd15fb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:29.008874 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5e4855d4-9230-41a7-a720-29eba5cd15fb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:29.009999 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5e4855d4-9230-41a7-a720-29eba5cd15fb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:29.011297 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5e4855d4-9230-41a7-a720-29eba5cd15fb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:29.012038 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5e4855d4-9230-41a7-a720-29eba5cd15fb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:29.271364 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-5e4855d4-9230-41a7-a720-29eba5cd15fb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:29.295345 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-5e4855d4-9230-41a7-a720-29eba5cd15fb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.325820 Jun 21 18:30:29.297119 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 64/139] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:28 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:29.630712 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ac91c586-5fa5-4909-bb91-25ef4adad6bc tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:29.632187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ac91c586-5fa5-4909-bb91-25ef4adad6bc tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:29.662603 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ac91c586-5fa5-4909-bb91-25ef4adad6bc tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:29.663371 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ac91c586-5fa5-4909-bb91-25ef4adad6bc tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:29.666033 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ac91c586-5fa5-4909-bb91-25ef4adad6bc tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:29.667196 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ac91c586-5fa5-4909-bb91-25ef4adad6bc tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:30.008113 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-73bf4871-a783-41d5-991e-a7dd69124a12 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:30.011145 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-73bf4871-a783-41d5-991e-a7dd69124a12 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:30.072434 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=2 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:30.088938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-73bf4871-a783-41d5-991e-a7dd69124a12 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:30.094036 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-73bf4871-a783-41d5-991e-a7dd69124a12 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:30.098562 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-73bf4871-a783-41d5-991e-a7dd69124a12 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:30.106029 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-73bf4871-a783-41d5-991e-a7dd69124a12 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:30.223217 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ac91c586-5fa5-4909-bb91-25ef4adad6bc tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:30.247443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ac91c586-5fa5-4909-bb91-25ef4adad6bc tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1516 microversion: 2.1 time: 0.626538 Jun 21 18:30:30.253618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 76/140] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:29 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1516 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:30.266641 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-327eb683-b106-48e0-8958-0e12c0b70a92 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99924cd3-e479-4922-9e23-eda8cb44d8ce"}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:30.269254 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-327eb683-b106-48e0-8958-0e12c0b70a92 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:30.288323 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-327eb683-b106-48e0-8958-0e12c0b70a92 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:30.289691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-327eb683-b106-48e0-8958-0e12c0b70a92 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:30.291401 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-327eb683-b106-48e0-8958-0e12c0b70a92 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:30.292274 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-327eb683-b106-48e0-8958-0e12c0b70a92 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:30.555277 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-73bf4871-a783-41d5-991e-a7dd69124a12 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:30.571038 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-73bf4871-a783-41d5-991e-a7dd69124a12 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.574620 Jun 21 18:30:30.584957 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 65/141] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:29 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:30.591269 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-448eb27f-5362-408f-824a-def2ac9a8c70 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:30.592943 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-448eb27f-5362-408f-824a-def2ac9a8c70 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:30.609135 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-448eb27f-5362-408f-824a-def2ac9a8c70 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:30.609135 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-448eb27f-5362-408f-824a-def2ac9a8c70 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:30.610802 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-448eb27f-5362-408f-824a-def2ac9a8c70 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:30.612033 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-448eb27f-5362-408f-824a-def2ac9a8c70 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:30.849570 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.objects.instance [None req-448eb27f-5362-408f-824a-def2ac9a8c70 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lazy-loading 'flavor' on Instance uuid 9f480e87-eeb9-47b0-95b8-f3ef475d2843 {{(pid=118108) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:30:31.030697 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-448eb27f-5362-408f-824a-def2ac9a8c70 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "POST /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843/action" status: 200 len: 32 microversion: 2.1 time: 0.442913 Jun 21 18:30:31.032467 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 66/142] 10.222.0.87 () {60 vars in 1277 bytes} [Tue Jun 21 18:30:30 2022] POST /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843/action => generated 32 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 18:30:31.042702 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-05d74b46-8a1d-40e9-95f4-df7f5825ac5e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:31.043842 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-05d74b46-8a1d-40e9-95f4-df7f5825ac5e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:31.057112 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-05d74b46-8a1d-40e9-95f4-df7f5825ac5e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:31.058033 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-05d74b46-8a1d-40e9-95f4-df7f5825ac5e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:31.061832 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-05d74b46-8a1d-40e9-95f4-df7f5825ac5e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:31.062520 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-05d74b46-8a1d-40e9-95f4-df7f5825ac5e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:31.400584 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-05d74b46-8a1d-40e9-95f4-df7f5825ac5e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:31.430914 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-05d74b46-8a1d-40e9-95f4-df7f5825ac5e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.396326 Jun 21 18:30:31.436102 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 67/143] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:31 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:31.469367 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-ce4d7119-42b1-4b05-b810-6d575df57052 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:31.471234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-ce4d7119-42b1-4b05-b810-6d575df57052 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:31.498537 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ce4d7119-42b1-4b05-b810-6d575df57052 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:31.500393 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ce4d7119-42b1-4b05-b810-6d575df57052 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:31.502897 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ce4d7119-42b1-4b05-b810-6d575df57052 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:31.504831 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ce4d7119-42b1-4b05-b810-6d575df57052 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:31.978558 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ce4d7119-42b1-4b05-b810-6d575df57052 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:31.992834 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-ce4d7119-42b1-4b05-b810-6d575df57052 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1522 microversion: 2.1 time: 0.551531 Jun 21 18:30:31.994173 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 68/144] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:31 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1522 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:31.999739 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-7deb183c-696b-4dba-9738-9b003dc3ac54 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:32.000359 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-7deb183c-696b-4dba-9738-9b003dc3ac54 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:32.009704 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7deb183c-696b-4dba-9738-9b003dc3ac54 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:32.011118 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7deb183c-696b-4dba-9738-9b003dc3ac54 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:32.012191 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7deb183c-696b-4dba-9738-9b003dc3ac54 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:32.012844 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7deb183c-696b-4dba-9738-9b003dc3ac54 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:32.361953 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-7deb183c-696b-4dba-9738-9b003dc3ac54 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:32.387933 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-7deb183c-696b-4dba-9738-9b003dc3ac54 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.392171 Jun 21 18:30:32.389831 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 69/145] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:31 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:32.459294 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d57ef2dc-bd96-4abe-a581-842c8b173f9e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:32.463396 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-d57ef2dc-bd96-4abe-a581-842c8b173f9e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:32.499448 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d57ef2dc-bd96-4abe-a581-842c8b173f9e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:32.499892 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d57ef2dc-bd96-4abe-a581-842c8b173f9e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:32.500712 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d57ef2dc-bd96-4abe-a581-842c8b173f9e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:32.504014 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d57ef2dc-bd96-4abe-a581-842c8b173f9e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:33.172989 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-d57ef2dc-bd96-4abe-a581-842c8b173f9e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:33.188872 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-d57ef2dc-bd96-4abe-a581-842c8b173f9e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.739421 Jun 21 18:30:33.201815 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 70/146] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:32 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:33.209969 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-575beffd-0e2e-46c1-892a-0c8022069fb6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:33.211314 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-575beffd-0e2e-46c1-892a-0c8022069fb6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:33.229280 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-575beffd-0e2e-46c1-892a-0c8022069fb6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:33.229759 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-575beffd-0e2e-46c1-892a-0c8022069fb6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:33.230549 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-575beffd-0e2e-46c1-892a-0c8022069fb6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:33.231470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-575beffd-0e2e-46c1-892a-0c8022069fb6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:33.459052 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-575beffd-0e2e-46c1-892a-0c8022069fb6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:33.476437 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-575beffd-0e2e-46c1-892a-0c8022069fb6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1522 microversion: 2.1 time: 0.272376 Jun 21 18:30:33.477555 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 71/147] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:33 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:33.500102 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c69671c3-06d7-45d4-97f2-703926017d9b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:33.501265 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c69671c3-06d7-45d4-97f2-703926017d9b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:33.512188 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c69671c3-06d7-45d4-97f2-703926017d9b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:33.513156 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c69671c3-06d7-45d4-97f2-703926017d9b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:33.514501 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c69671c3-06d7-45d4-97f2-703926017d9b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:33.515562 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c69671c3-06d7-45d4-97f2-703926017d9b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:33.743020 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c69671c3-06d7-45d4-97f2-703926017d9b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:33.766640 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c69671c3-06d7-45d4-97f2-703926017d9b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.285716 Jun 21 18:30:33.769810 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 72/148] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:33 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:34.218336 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4be90c22-830f-4199-8b72-62beaeb0daf6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:34.219609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4be90c22-830f-4199-8b72-62beaeb0daf6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:34.260879 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4be90c22-830f-4199-8b72-62beaeb0daf6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:34.264829 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4be90c22-830f-4199-8b72-62beaeb0daf6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:34.273861 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4be90c22-830f-4199-8b72-62beaeb0daf6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:34.277415 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4be90c22-830f-4199-8b72-62beaeb0daf6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:34.397252 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:34.447168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-327eb683-b106-48e0-8958-0e12c0b70a92 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "POST /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.187087 Jun 21 18:30:34.453587 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 77/149] 10.222.0.87 () {60 vars in 1322 bytes} [Tue Jun 21 18:30:30 2022] POST /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5/os-volume_attachments => generated 194 bytes in 4199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:30:34.513243 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-71c2d9be-57a1-4125-826d-5ca096922212 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:34.516808 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-71c2d9be-57a1-4125-826d-5ca096922212 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:34.562984 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-71c2d9be-57a1-4125-826d-5ca096922212 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:34.574161 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-71c2d9be-57a1-4125-826d-5ca096922212 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:34.579515 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-71c2d9be-57a1-4125-826d-5ca096922212 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:34.584180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-71c2d9be-57a1-4125-826d-5ca096922212 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:34.862302 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-4be90c22-830f-4199-8b72-62beaeb0daf6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:34.891007 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4be90c22-830f-4199-8b72-62beaeb0daf6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.686921 Jun 21 18:30:34.892060 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 73/150] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:34 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:34.912773 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-3602ae91-ecb5-4d3c-8369-6820b15dd7bb req-8e11936d-cf2a-429b-bbf7-2100b170c75d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9d70a7-2f59-4922-a22c-14fe01056ae4", "name": "network-vif-plugged", "status": "completed", "tag": "8a1f2f86-cb5f-43ed-b726-88cd6b15b327"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:34.957513 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-3602ae91-ecb5-4d3c-8369-6820b15dd7bb req-8e11936d-cf2a-429b-bbf7-2100b170c75d service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:34.960555 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-3602ae91-ecb5-4d3c-8369-6820b15dd7bb req-8e11936d-cf2a-429b-bbf7-2100b170c75d service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:35.021533 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-3602ae91-ecb5-4d3c-8369-6820b15dd7bb req-8e11936d-cf2a-429b-bbf7-2100b170c75d service nova] Creating event network-vif-plugged:8a1f2f86-cb5f-43ed-b726-88cd6b15b327 for instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 on hv-cinder-84460 Jun 21 18:30:35.047352 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-3602ae91-ecb5-4d3c-8369-6820b15dd7bb req-8e11936d-cf2a-429b-bbf7-2100b170c75d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145361 Jun 21 18:30:35.060097 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 74/151] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:30:35.072104 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6c6ff0d9-38bc-4d0e-9645-1bd2d48cb153 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:35.078299 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-6c6ff0d9-38bc-4d0e-9645-1bd2d48cb153 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:35.103962 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6c6ff0d9-38bc-4d0e-9645-1bd2d48cb153 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:35.104759 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6c6ff0d9-38bc-4d0e-9645-1bd2d48cb153 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:35.106485 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6c6ff0d9-38bc-4d0e-9645-1bd2d48cb153 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:35.107260 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6c6ff0d9-38bc-4d0e-9645-1bd2d48cb153 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:35.110312 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-71c2d9be-57a1-4125-826d-5ca096922212 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:35.138015 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-71c2d9be-57a1-4125-826d-5ca096922212 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1522 microversion: 2.1 time: 0.630104 Jun 21 18:30:35.139601 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 78/152] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:34 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1522 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:35.436473 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6c6ff0d9-38bc-4d0e-9645-1bd2d48cb153 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:35.461864 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6c6ff0d9-38bc-4d0e-9645-1bd2d48cb153 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.390048 Jun 21 18:30:35.461864 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 75/153] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:35 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:35.930747 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8f5951ce-42ec-4427-ad84-84693f048a85 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:35.931851 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8f5951ce-42ec-4427-ad84-84693f048a85 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:35.971910 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8f5951ce-42ec-4427-ad84-84693f048a85 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:35.972981 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8f5951ce-42ec-4427-ad84-84693f048a85 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:35.975916 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8f5951ce-42ec-4427-ad84-84693f048a85 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:35.978049 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8f5951ce-42ec-4427-ad84-84693f048a85 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:36.170066 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-52b6e717-902d-48ba-84ab-91d07f696e40 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:36.172635 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-52b6e717-902d-48ba-84ab-91d07f696e40 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:36.185192 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-52b6e717-902d-48ba-84ab-91d07f696e40 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:36.187472 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-52b6e717-902d-48ba-84ab-91d07f696e40 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:36.188926 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-52b6e717-902d-48ba-84ab-91d07f696e40 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:36.189923 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-52b6e717-902d-48ba-84ab-91d07f696e40 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:36.354257 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-8f5951ce-42ec-4427-ad84-84693f048a85 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:36.371483 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8f5951ce-42ec-4427-ad84-84693f048a85 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.450441 Jun 21 18:30:36.372408 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 79/154] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:35 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:36.475190 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-52b6e717-902d-48ba-84ab-91d07f696e40 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:36.487760 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-cab9d53a-3815-4166-b5fd-ef5d2d8f1a25 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:36.489205 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-cab9d53a-3815-4166-b5fd-ef5d2d8f1a25 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:36.498320 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-52b6e717-902d-48ba-84ab-91d07f696e40 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1522 microversion: 2.1 time: 0.336468 Jun 21 18:30:36.505745 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cab9d53a-3815-4166-b5fd-ef5d2d8f1a25 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:36.509959 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cab9d53a-3815-4166-b5fd-ef5d2d8f1a25 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:36.511222 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 76/155] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:36 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:36.511928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cab9d53a-3815-4166-b5fd-ef5d2d8f1a25 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:36.512943 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cab9d53a-3815-4166-b5fd-ef5d2d8f1a25 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:36.739416 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-cab9d53a-3815-4166-b5fd-ef5d2d8f1a25 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:36.753818 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-cab9d53a-3815-4166-b5fd-ef5d2d8f1a25 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.274586 Jun 21 18:30:36.754818 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 80/156] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:36 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:37.402851 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-63bfd686-e81e-44a7-a27f-c5f6489dc054 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:37.404554 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-63bfd686-e81e-44a7-a27f-c5f6489dc054 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:37.420682 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-63bfd686-e81e-44a7-a27f-c5f6489dc054 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:37.421871 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-63bfd686-e81e-44a7-a27f-c5f6489dc054 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:37.423260 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-63bfd686-e81e-44a7-a27f-c5f6489dc054 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:37.424095 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-63bfd686-e81e-44a7-a27f-c5f6489dc054 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:37.549475 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c55b9192-a112-4414-ab0d-90bd1be6549b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:37.551341 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c55b9192-a112-4414-ab0d-90bd1be6549b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:37.579228 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c55b9192-a112-4414-ab0d-90bd1be6549b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:37.580354 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c55b9192-a112-4414-ab0d-90bd1be6549b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:37.582380 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c55b9192-a112-4414-ab0d-90bd1be6549b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:37.583432 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c55b9192-a112-4414-ab0d-90bd1be6549b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:37.645556 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-63bfd686-e81e-44a7-a27f-c5f6489dc054 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:37.663635 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-63bfd686-e81e-44a7-a27f-c5f6489dc054 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.267744 Jun 21 18:30:37.665193 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 77/157] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:37 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:37.783624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-0299e02b-f57e-4557-9642-1b8592d26309 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:37.789146 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-0299e02b-f57e-4557-9642-1b8592d26309 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:37.802028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0299e02b-f57e-4557-9642-1b8592d26309 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:37.802858 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0299e02b-f57e-4557-9642-1b8592d26309 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:37.804524 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0299e02b-f57e-4557-9642-1b8592d26309 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:37.807406 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0299e02b-f57e-4557-9642-1b8592d26309 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:37.932405 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c55b9192-a112-4414-ab0d-90bd1be6549b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:37.966975 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c55b9192-a112-4414-ab0d-90bd1be6549b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1522 microversion: 2.1 time: 0.428743 Jun 21 18:30:37.993914 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 81/158] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:37 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:38.266806 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-0299e02b-f57e-4557-9642-1b8592d26309 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:38.288942 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-0299e02b-f57e-4557-9642-1b8592d26309 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.514381 Jun 21 18:30:38.313289 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 78/159] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:37 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:38.718920 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-962f6f2f-6d74-42f6-95ac-9d9defa48d8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:38.729232 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-962f6f2f-6d74-42f6-95ac-9d9defa48d8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:38.756335 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-962f6f2f-6d74-42f6-95ac-9d9defa48d8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:38.757796 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-962f6f2f-6d74-42f6-95ac-9d9defa48d8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:38.761037 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-962f6f2f-6d74-42f6-95ac-9d9defa48d8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:38.762099 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-962f6f2f-6d74-42f6-95ac-9d9defa48d8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:39.031469 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-61b3a934-353e-4946-93f5-dd4cfff97431 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:39.042762 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-61b3a934-353e-4946-93f5-dd4cfff97431 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:39.067213 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-61b3a934-353e-4946-93f5-dd4cfff97431 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:39.068156 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-61b3a934-353e-4946-93f5-dd4cfff97431 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:39.069574 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-61b3a934-353e-4946-93f5-dd4cfff97431 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:39.079528 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-61b3a934-353e-4946-93f5-dd4cfff97431 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:39.187994 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-962f6f2f-6d74-42f6-95ac-9d9defa48d8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:39.221545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-962f6f2f-6d74-42f6-95ac-9d9defa48d8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.529014 Jun 21 18:30:39.227682 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 82/160] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:38 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:39.327808 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ca9586eb-2bd3-47c7-b768-c24a5285f773 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:39.329273 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ca9586eb-2bd3-47c7-b768-c24a5285f773 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:39.364263 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ca9586eb-2bd3-47c7-b768-c24a5285f773 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:39.364858 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ca9586eb-2bd3-47c7-b768-c24a5285f773 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:39.365999 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ca9586eb-2bd3-47c7-b768-c24a5285f773 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:39.366443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ca9586eb-2bd3-47c7-b768-c24a5285f773 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:39.939417 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-61b3a934-353e-4946-93f5-dd4cfff97431 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:39.964063 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-61b3a934-353e-4946-93f5-dd4cfff97431 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1522 microversion: 2.1 time: 0.950579 Jun 21 18:30:39.979643 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 79/161] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:39 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1522 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:40.003647 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ca9586eb-2bd3-47c7-b768-c24a5285f773 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:40.031259 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ca9586eb-2bd3-47c7-b768-c24a5285f773 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.710197 Jun 21 18:30:40.034683 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 83/162] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:39 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:40.269237 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6a2f0bb4-c315-4ed5-83da-435dd938ab62 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:40.270333 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-6a2f0bb4-c315-4ed5-83da-435dd938ab62 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:40.302931 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6a2f0bb4-c315-4ed5-83da-435dd938ab62 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:40.303661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6a2f0bb4-c315-4ed5-83da-435dd938ab62 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:40.304992 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6a2f0bb4-c315-4ed5-83da-435dd938ab62 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:40.307262 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6a2f0bb4-c315-4ed5-83da-435dd938ab62 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:40.922341 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6a2f0bb4-c315-4ed5-83da-435dd938ab62 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:40.982057 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6a2f0bb4-c315-4ed5-83da-435dd938ab62 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1367 microversion: 2.1 time: 0.716291 Jun 21 18:30:40.986284 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 80/163] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:40 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1367 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:41.009992 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-557d9406-2dea-4aea-9521-6010c6e6f79b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:41.011994 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-557d9406-2dea-4aea-9521-6010c6e6f79b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:41.027848 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-557d9406-2dea-4aea-9521-6010c6e6f79b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:41.028324 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-557d9406-2dea-4aea-9521-6010c6e6f79b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:41.029110 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-557d9406-2dea-4aea-9521-6010c6e6f79b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:41.029540 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-557d9406-2dea-4aea-9521-6010c6e6f79b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:41.080588 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6294dd3a-9d44-4f77-8cba-3f12582d6dca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:41.084677 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-6294dd3a-9d44-4f77-8cba-3f12582d6dca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:41.108662 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6294dd3a-9d44-4f77-8cba-3f12582d6dca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:41.109413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6294dd3a-9d44-4f77-8cba-3f12582d6dca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:41.110637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6294dd3a-9d44-4f77-8cba-3f12582d6dca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:41.111148 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6294dd3a-9d44-4f77-8cba-3f12582d6dca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:41.652529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-557d9406-2dea-4aea-9521-6010c6e6f79b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:41.695375 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-557d9406-2dea-4aea-9521-6010c6e6f79b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1522 microversion: 2.1 time: 0.694470 Jun 21 18:30:41.713219 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 84/164] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:40 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1522 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:41.713514 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6294dd3a-9d44-4f77-8cba-3f12582d6dca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:41.744326 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6294dd3a-9d44-4f77-8cba-3f12582d6dca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.671189 Jun 21 18:30:41.751487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 81/165] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:41 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:42.024797 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-eda9c723-ba05-4a17-846b-fb8f4f499582 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:42.029134 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-eda9c723-ba05-4a17-846b-fb8f4f499582 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:42.056154 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-eda9c723-ba05-4a17-846b-fb8f4f499582 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:42.058320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-eda9c723-ba05-4a17-846b-fb8f4f499582 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:42.061133 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-eda9c723-ba05-4a17-846b-fb8f4f499582 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:42.062285 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-eda9c723-ba05-4a17-846b-fb8f4f499582 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:42.651636 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-eda9c723-ba05-4a17-846b-fb8f4f499582 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:42.695206 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-eda9c723-ba05-4a17-846b-fb8f4f499582 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1556 microversion: 2.1 time: 0.686466 Jun 21 18:30:42.702267 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 85/166] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:42 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1556 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:42.734628 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b6173034-fa63-4e4b-9c3c-00f27f3db11e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:42.739828 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b6173034-fa63-4e4b-9c3c-00f27f3db11e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:42.744614 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-fcd44ead-ce8f-4d68-b9a1-b5e9de47a749 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:42.745401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-fcd44ead-ce8f-4d68-b9a1-b5e9de47a749 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:42.772176 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fcd44ead-ce8f-4d68-b9a1-b5e9de47a749 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:42.772734 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fcd44ead-ce8f-4d68-b9a1-b5e9de47a749 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:42.781195 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fcd44ead-ce8f-4d68-b9a1-b5e9de47a749 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:42.781869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fcd44ead-ce8f-4d68-b9a1-b5e9de47a749 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:42.788800 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b6173034-fa63-4e4b-9c3c-00f27f3db11e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:42.793218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b6173034-fa63-4e4b-9c3c-00f27f3db11e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:42.796045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b6173034-fa63-4e4b-9c3c-00f27f3db11e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:42.801081 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b6173034-fa63-4e4b-9c3c-00f27f3db11e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:43.383590 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-fcd44ead-ce8f-4d68-b9a1-b5e9de47a749 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.661972 Jun 21 18:30:43.385026 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 82/167] 10.222.0.87 () {58 vars in 1274 bytes} [Tue Jun 21 18:30:42 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4/os-interface => generated 284 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:30:43.398042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-96011689-5f5f-4df7-9b0a-038f698034d9 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:43.399263 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-96011689-5f5f-4df7-9b0a-038f698034d9 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:43.446349 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-96011689-5f5f-4df7-9b0a-038f698034d9 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:43.450841 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-96011689-5f5f-4df7-9b0a-038f698034d9 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:43.454944 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-96011689-5f5f-4df7-9b0a-038f698034d9 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:43.464828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-96011689-5f5f-4df7-9b0a-038f698034d9 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:43.793209 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b6173034-fa63-4e4b-9c3c-00f27f3db11e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:43.838497 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b6173034-fa63-4e4b-9c3c-00f27f3db11e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1522 microversion: 2.1 time: 1.115209 Jun 21 18:30:43.849585 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 86/168] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:42 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1522 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:43.872269 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-96e3b473-256d-4374-af09-992aa840a6b3 req-c9c59272-29e5-4080-ac32-a3fb24721bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e", "name": "network-vif-plugged", "status": "completed", "tag": "0c04c020-626c-4450-aa54-6781ab086cee"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:43.893106 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-96e3b473-256d-4374-af09-992aa840a6b3 req-c9c59272-29e5-4080-ac32-a3fb24721bea service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:43.894666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-96e3b473-256d-4374-af09-992aa840a6b3 req-c9c59272-29e5-4080-ac32-a3fb24721bea service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:43.927939 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-96e3b473-256d-4374-af09-992aa840a6b3 req-c9c59272-29e5-4080-ac32-a3fb24721bea service nova] Creating event network-vif-plugged:0c04c020-626c-4450-aa54-6781ab086cee for instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e on hv-cinder-84460 Jun 21 18:30:43.938887 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-96e3b473-256d-4374-af09-992aa840a6b3 req-c9c59272-29e5-4080-ac32-a3fb24721bea service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083272 Jun 21 18:30:43.941059 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 87/169] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:30:44.814478 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-96011689-5f5f-4df7-9b0a-038f698034d9 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:44.853750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-96011689-5f5f-4df7-9b0a-038f698034d9 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 1.466087 Jun 21 18:30:44.859955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 83/170] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:43 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:44.894884 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-178736a9-227e-4f8b-9c7e-a0540d846c49 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:44.899474 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-178736a9-227e-4f8b-9c7e-a0540d846c49 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:44.935137 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-178736a9-227e-4f8b-9c7e-a0540d846c49 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:44.939097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-178736a9-227e-4f8b-9c7e-a0540d846c49 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:44.943310 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-178736a9-227e-4f8b-9c7e-a0540d846c49 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:44.948603 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-178736a9-227e-4f8b-9c7e-a0540d846c49 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:45.901382 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-42736ff8-3216-4e73-9dc2-3c561f92b390 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:45.903946 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-178736a9-227e-4f8b-9c7e-a0540d846c49 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:45.916045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-178736a9-227e-4f8b-9c7e-a0540d846c49 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1522 microversion: 2.1 time: 1.041899 Jun 21 18:30:45.916731 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-42736ff8-3216-4e73-9dc2-3c561f92b390 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:45.922935 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 88/171] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:44 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1522 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:45.958395 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-42736ff8-3216-4e73-9dc2-3c561f92b390 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:45.959142 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-42736ff8-3216-4e73-9dc2-3c561f92b390 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:45.959992 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-42736ff8-3216-4e73-9dc2-3c561f92b390 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:45.960428 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-42736ff8-3216-4e73-9dc2-3c561f92b390 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:46.848458 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-42736ff8-3216-4e73-9dc2-3c561f92b390 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:46.949332 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1b77671e-9efb-4aab-89ec-1b0e27128c52 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:46.955425 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1b77671e-9efb-4aab-89ec-1b0e27128c52 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:46.962674 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-42736ff8-3216-4e73-9dc2-3c561f92b390 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 1.075745 Jun 21 18:30:46.968393 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 84/172] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:45 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:46.992146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b77671e-9efb-4aab-89ec-1b0e27128c52 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:46.994459 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b77671e-9efb-4aab-89ec-1b0e27128c52 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:46.995924 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b77671e-9efb-4aab-89ec-1b0e27128c52 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:47.007500 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b77671e-9efb-4aab-89ec-1b0e27128c52 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:47.709406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1b77671e-9efb-4aab-89ec-1b0e27128c52 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:47.737275 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1b77671e-9efb-4aab-89ec-1b0e27128c52 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1522 microversion: 2.1 time: 0.799901 Jun 21 18:30:47.739937 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 89/173] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:46 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1522 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:47.992752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4ee817e0-f079-439e-9140-1118c8391e10 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:47.993780 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4ee817e0-f079-439e-9140-1118c8391e10 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:48.021102 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4ee817e0-f079-439e-9140-1118c8391e10 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:48.021574 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4ee817e0-f079-439e-9140-1118c8391e10 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:48.022964 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4ee817e0-f079-439e-9140-1118c8391e10 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:48.023721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4ee817e0-f079-439e-9140-1118c8391e10 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:48.726252 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-4ee817e0-f079-439e-9140-1118c8391e10 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:48.774013 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-73257874-dad3-4429-983d-0f288e3c9668 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:48.777817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-73257874-dad3-4429-983d-0f288e3c9668 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:48.793343 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4ee817e0-f079-439e-9140-1118c8391e10 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1363 microversion: 2.1 time: 0.807361 Jun 21 18:30:48.824621 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 85/174] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:47 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1363 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:48.833812 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-73257874-dad3-4429-983d-0f288e3c9668 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:48.834364 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-73257874-dad3-4429-983d-0f288e3c9668 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:48.842482 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-73257874-dad3-4429-983d-0f288e3c9668 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:48.843831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-73257874-dad3-4429-983d-0f288e3c9668 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:49.727441 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-73257874-dad3-4429-983d-0f288e3c9668 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:49.765824 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-73257874-dad3-4429-983d-0f288e3c9668 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1522 microversion: 2.1 time: 1.001977 Jun 21 18:30:49.774375 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 90/175] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:48 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1522 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:49.829540 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f808d534-1cc4-4c28-81d4-97bc71352a76 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:49.832091 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f808d534-1cc4-4c28-81d4-97bc71352a76 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:49.858520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f808d534-1cc4-4c28-81d4-97bc71352a76 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:49.859210 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f808d534-1cc4-4c28-81d4-97bc71352a76 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:49.860612 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f808d534-1cc4-4c28-81d4-97bc71352a76 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:49.876489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f808d534-1cc4-4c28-81d4-97bc71352a76 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:49.906320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:49.979965 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-371f5709-b66e-40f1-8d78-eff9c7eb6695 req-14ddc5bb-20be-487c-8758-1dcb2d35a171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9d70a7-2f59-4922-a22c-14fe01056ae4", "tag": "8a1f2f86-cb5f-43ed-b726-88cd6b15b327"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:49.985025 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=72 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:50.014286 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-371f5709-b66e-40f1-8d78-eff9c7eb6695 req-14ddc5bb-20be-487c-8758-1dcb2d35a171 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:50.014999 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-371f5709-b66e-40f1-8d78-eff9c7eb6695 req-14ddc5bb-20be-487c-8758-1dcb2d35a171 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:50.055514 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-371f5709-b66e-40f1-8d78-eff9c7eb6695 req-14ddc5bb-20be-487c-8758-1dcb2d35a171 service nova] Creating event network-changed:8a1f2f86-cb5f-43ed-b726-88cd6b15b327 for instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 on hv-cinder-84460 Jun 21 18:30:50.073383 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-371f5709-b66e-40f1-8d78-eff9c7eb6695 req-14ddc5bb-20be-487c-8758-1dcb2d35a171 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.415720 Jun 21 18:30:50.075099 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 86/176] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:30:50.516528 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f808d534-1cc4-4c28-81d4-97bc71352a76 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:50.569476 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f808d534-1cc4-4c28-81d4-97bc71352a76 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1548 microversion: 2.1 time: 0.741624 Jun 21 18:30:50.586206 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 91/177] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:49 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1548 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:50.606913 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-ef56e8a8-1c4c-4fda-a790-59fd200b827f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:50.607786 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-ef56e8a8-1c4c-4fda-a790-59fd200b827f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:50.616406 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef56e8a8-1c4c-4fda-a790-59fd200b827f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:50.617269 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef56e8a8-1c4c-4fda-a790-59fd200b827f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:50.618868 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef56e8a8-1c4c-4fda-a790-59fd200b827f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:50.620271 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef56e8a8-1c4c-4fda-a790-59fd200b827f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:50.743328 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c5811ddf-7e13-4cb6-ab01-781d48eaffa9 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:50.744573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c5811ddf-7e13-4cb6-ab01-781d48eaffa9 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:50.766445 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c5811ddf-7e13-4cb6-ab01-781d48eaffa9 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:50.767557 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c5811ddf-7e13-4cb6-ab01-781d48eaffa9 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:50.768844 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c5811ddf-7e13-4cb6-ab01-781d48eaffa9 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:50.771772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c5811ddf-7e13-4cb6-ab01-781d48eaffa9 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:50.883408 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-ef56e8a8-1c4c-4fda-a790-59fd200b827f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.281984 Jun 21 18:30:50.884165 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 87/178] 10.222.0.87 () {58 vars in 1274 bytes} [Tue Jun 21 18:30:50 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e/os-interface => generated 284 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:30:50.892831 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-77ddbef4-00a1-4f78-8482-30618e8bdd4c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:50.902981 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-77ddbef4-00a1-4f78-8482-30618e8bdd4c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:50.903423 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c5811ddf-7e13-4cb6-ab01-781d48eaffa9 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Going to try to terminate instance {{(pid=118109) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:30:50.931737 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-77ddbef4-00a1-4f78-8482-30618e8bdd4c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:50.945942 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-77ddbef4-00a1-4f78-8482-30618e8bdd4c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:50.945942 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-77ddbef4-00a1-4f78-8482-30618e8bdd4c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:50.945942 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-77ddbef4-00a1-4f78-8482-30618e8bdd4c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:51.316915 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c5811ddf-7e13-4cb6-ab01-781d48eaffa9 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "DELETE /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 204 len: 0 microversion: 2.1 time: 0.578470 Jun 21 18:30:51.320417 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 92/179] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:30:50 2022] DELETE /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:30:51.338302 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-badc483a-3ac2-4873-88ae-e6edb8da58e6 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:51.341461 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-badc483a-3ac2-4873-88ae-e6edb8da58e6 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:51.359003 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-badc483a-3ac2-4873-88ae-e6edb8da58e6 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:51.363297 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-badc483a-3ac2-4873-88ae-e6edb8da58e6 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:51.371819 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-badc483a-3ac2-4873-88ae-e6edb8da58e6 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:51.372688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-badc483a-3ac2-4873-88ae-e6edb8da58e6 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:51.729235 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-77ddbef4-00a1-4f78-8482-30618e8bdd4c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:51.764019 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-77ddbef4-00a1-4f78-8482-30618e8bdd4c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1522 microversion: 2.1 time: 0.877523 Jun 21 18:30:51.774530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 88/180] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:50 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1522 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:51.999030 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-badc483a-3ac2-4873-88ae-e6edb8da58e6 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:52.018574 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-badc483a-3ac2-4873-88ae-e6edb8da58e6 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1553 microversion: 2.1 time: 0.690693 Jun 21 18:30:52.022649 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 93/181] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:51 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1553 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:52.801208 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-fea96212-b87e-4bd8-89cd-9a8c4d4dc5e8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:52.816359 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-fea96212-b87e-4bd8-89cd-9a8c4d4dc5e8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:52.843198 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fea96212-b87e-4bd8-89cd-9a8c4d4dc5e8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:52.844532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fea96212-b87e-4bd8-89cd-9a8c4d4dc5e8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:52.878828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fea96212-b87e-4bd8-89cd-9a8c4d4dc5e8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:52.879752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fea96212-b87e-4bd8-89cd-9a8c4d4dc5e8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:53.051745 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8dc5638e-bfb2-4f0a-8f41-1accbb0ffb3a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:53.053253 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8dc5638e-bfb2-4f0a-8f41-1accbb0ffb3a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:53.080375 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8dc5638e-bfb2-4f0a-8f41-1accbb0ffb3a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:53.082079 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8dc5638e-bfb2-4f0a-8f41-1accbb0ffb3a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:53.086032 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8dc5638e-bfb2-4f0a-8f41-1accbb0ffb3a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:53.087806 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8dc5638e-bfb2-4f0a-8f41-1accbb0ffb3a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:53.808690 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-fea96212-b87e-4bd8-89cd-9a8c4d4dc5e8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:53.831318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-fea96212-b87e-4bd8-89cd-9a8c4d4dc5e8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1522 microversion: 2.1 time: 1.037786 Jun 21 18:30:53.832329 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 89/182] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:52 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1522 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:54.263907 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-8dc5638e-bfb2-4f0a-8f41-1accbb0ffb3a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:54.302594 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-4876a28a-3fca-47e8-aa36-9beeaf995b9e req-3b9e13dc-a5be-4670-a30f-59a97023d4be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e", "tag": "0c04c020-626c-4450-aa54-6781ab086cee"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:54.314076 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8dc5638e-bfb2-4f0a-8f41-1accbb0ffb3a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1553 microversion: 2.1 time: 1.259755 Jun 21 18:30:54.315281 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 94/183] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:53 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1553 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:54.334648 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-4876a28a-3fca-47e8-aa36-9beeaf995b9e req-3b9e13dc-a5be-4670-a30f-59a97023d4be service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:54.336313 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-4876a28a-3fca-47e8-aa36-9beeaf995b9e req-3b9e13dc-a5be-4670-a30f-59a97023d4be service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:54.378225 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-4876a28a-3fca-47e8-aa36-9beeaf995b9e req-3b9e13dc-a5be-4670-a30f-59a97023d4be service nova] Creating event network-changed:0c04c020-626c-4450-aa54-6781ab086cee for instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e on hv-cinder-84460 Jun 21 18:30:54.395680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-4876a28a-3fca-47e8-aa36-9beeaf995b9e req-3b9e13dc-a5be-4670-a30f-59a97023d4be service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105264 Jun 21 18:30:54.398033 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 90/184] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:30:54.865523 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a99e66ef-d474-4e29-9152-8fc90ad15713 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:54.868751 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-a99e66ef-d474-4e29-9152-8fc90ad15713 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:54.894021 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a99e66ef-d474-4e29-9152-8fc90ad15713 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:54.895993 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a99e66ef-d474-4e29-9152-8fc90ad15713 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:54.900058 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a99e66ef-d474-4e29-9152-8fc90ad15713 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:54.902550 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a99e66ef-d474-4e29-9152-8fc90ad15713 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:55.221417 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-46bb3bdc-b395-42ff-bd1f-66b19420d028 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1699675582", "imageRef": "c28659fb-c2d3-4dda-a330-1323a974987e", "flavorRef": "452", "networks": [{"uuid": "822fd099-0b53-4ae6-922b-7d0357c71362"}]}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:55.435152 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.network.neutron [None req-46bb3bdc-b395-42ff-bd1f-66b19420d028 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] validate_networks() for [('822fd099-0b53-4ae6-922b-7d0357c71362', None, None, None, None, None)] {{(pid=118108) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:30:55.827545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-a99e66ef-d474-4e29-9152-8fc90ad15713 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:55.845310 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-a99e66ef-d474-4e29-9152-8fc90ad15713 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1522 microversion: 2.1 time: 0.986372 Jun 21 18:30:55.851557 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 95/185] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:54 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1522 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:55.873221 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-d912a0b1-eeeb-4083-8e5d-9581ee803c2a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:55.883632 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-d912a0b1-eeeb-4083-8e5d-9581ee803c2a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:55.886136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:30:55.931182 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d912a0b1-eeeb-4083-8e5d-9581ee803c2a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:55.935715 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d912a0b1-eeeb-4083-8e5d-9581ee803c2a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:55.937550 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d912a0b1-eeeb-4083-8e5d-9581ee803c2a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:55.938369 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d912a0b1-eeeb-4083-8e5d-9581ee803c2a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:57.646191 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-d912a0b1-eeeb-4083-8e5d-9581ee803c2a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:57.665408 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-d912a0b1-eeeb-4083-8e5d-9581ee803c2a tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1553 microversion: 2.1 time: 1.804453 Jun 21 18:30:57.666906 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 96/186] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:55 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1553 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:57.683468 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-859c7522-aac1-4e04-a884-f00e0024a24c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:57.689256 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-859c7522-aac1-4e04-a884-f00e0024a24c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:57.711711 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-859c7522-aac1-4e04-a884-f00e0024a24c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:57.716744 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-859c7522-aac1-4e04-a884-f00e0024a24c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:57.720224 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-859c7522-aac1-4e04-a884-f00e0024a24c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:57.728482 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-859c7522-aac1-4e04-a884-f00e0024a24c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:58.253718 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-46bb3bdc-b395-42ff-bd1f-66b19420d028 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Flavor limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:30:58.254479 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-46bb3bdc-b395-42ff-bd1f-66b19420d028 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Image limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:30:58.254994 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-46bb3bdc-b395-42ff-bd1f-66b19420d028 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Flavor pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:30:58.255532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-46bb3bdc-b395-42ff-bd1f-66b19420d028 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Image pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:30:58.256119 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-46bb3bdc-b395-42ff-bd1f-66b19420d028 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:30:58.281326 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-46bb3bdc-b395-42ff-bd1f-66b19420d028 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:58.282740 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-46bb3bdc-b395-42ff-bd1f-66b19420d028 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:58.284948 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-46bb3bdc-b395-42ff-bd1f-66b19420d028 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:58.285920 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-46bb3bdc-b395-42ff-bd1f-66b19420d028 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:58.299346 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-859c7522-aac1-4e04-a884-f00e0024a24c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:58.328277 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-859c7522-aac1-4e04-a884-f00e0024a24c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1522 microversion: 2.1 time: 0.641963 Jun 21 18:30:58.330861 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 97/187] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:57 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1522 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:58.349304 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-107f8499-9f53-4b82-857c-7aefe6f92f2f req-7634ba04-d870-43e5-bdcf-313685a883dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5", "name": "network-vif-deleted", "tag": "b9bbbf5a-5964-4d39-9046-b5480e68aa1e"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:30:58.372619 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-107f8499-9f53-4b82-857c-7aefe6f92f2f req-7634ba04-d870-43e5-bdcf-313685a883dc service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:58.373289 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-107f8499-9f53-4b82-857c-7aefe6f92f2f req-7634ba04-d870-43e5-bdcf-313685a883dc service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:58.381160 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-46bb3bdc-b395-42ff-bd1f-66b19420d028 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Getting quotas for project 0307481a33be4b268d2793bb65f9d9ef. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:30:58.400923 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-46bb3bdc-b395-42ff-bd1f-66b19420d028 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Getting quotas for user 82c323bc7a8c45e39714bb3e7f401c3a and project 0307481a33be4b268d2793bb65f9d9ef. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:30:58.411568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-107f8499-9f53-4b82-857c-7aefe6f92f2f req-7634ba04-d870-43e5-bdcf-313685a883dc service nova] Creating event network-vif-deleted:b9bbbf5a-5964-4d39-9046-b5480e68aa1e for instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 on hv-cinder-84460 Jun 21 18:30:58.423675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-107f8499-9f53-4b82-857c-7aefe6f92f2f req-7634ba04-d870-43e5-bdcf-313685a883dc service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089546 Jun 21 18:30:58.433898 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 98/188] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:30:58.445504 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-46bb3bdc-b395-42ff-bd1f-66b19420d028 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Going to run 1 instances... {{(pid=118108) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:30:58.457701 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-46bb3bdc-b395-42ff-bd1f-66b19420d028 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c28659fb-c2d3-4dda-a330-1323a974987e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118108) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:30:58.631867 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-46bb3bdc-b395-42ff-bd1f-66b19420d028 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.421636 Jun 21 18:30:58.632831 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 91/189] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:30:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:30:58.651458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6f7088e7-7082-4500-8785-1c7f7ca84216 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:58.653927 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6f7088e7-7082-4500-8785-1c7f7ca84216 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:58.698075 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-329723ed-3e2a-4822-8db8-5f409c7f46d8 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:58.698988 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-329723ed-3e2a-4822-8db8-5f409c7f46d8 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:58.717004 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-329723ed-3e2a-4822-8db8-5f409c7f46d8 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:58.717908 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-329723ed-3e2a-4822-8db8-5f409c7f46d8 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:58.723160 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-329723ed-3e2a-4822-8db8-5f409c7f46d8 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:58.725096 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-329723ed-3e2a-4822-8db8-5f409c7f46d8 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:58.827901 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-6f7088e7-7082-4500-8785-1c7f7ca84216 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:58.838854 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6f7088e7-7082-4500-8785-1c7f7ca84216 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1214 microversion: 2.1 time: 0.196380 Jun 21 18:30:58.840959 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 99/190] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:58 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1214 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:30:58.844370 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-329723ed-3e2a-4822-8db8-5f409c7f46d8 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:58.845126 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-329723ed-3e2a-4822-8db8-5f409c7f46d8 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:58.845782 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.objects.instance [None req-329723ed-3e2a-4822-8db8-5f409c7f46d8 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lazy-loading 'fault' on Instance uuid 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 {{(pid=118108) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:30:58.948097 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-329723ed-3e2a-4822-8db8-5f409c7f46d8 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a03657e872e94266b12d95a602038cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad7bfb54384a4d648245aaf12c05ade7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:30:58.962833 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-329723ed-3e2a-4822-8db8-5f409c7f46d8 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 200 len: 1305 microversion: 2.1 time: 0.270428 Jun 21 18:30:58.964229 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 92/191] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:58 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 1305 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:30:59.364858 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-d8a7c906-ff10-4af1-a3e1-3935f094b2db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:59.366233 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-d8a7c906-ff10-4af1-a3e1-3935f094b2db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:59.387246 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d8a7c906-ff10-4af1-a3e1-3935f094b2db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:59.388015 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d8a7c906-ff10-4af1-a3e1-3935f094b2db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:59.390303 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d8a7c906-ff10-4af1-a3e1-3935f094b2db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:59.398736 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d8a7c906-ff10-4af1-a3e1-3935f094b2db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:59.873911 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-69b3dd5f-c6d2-4a95-846d-47649b7779c6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:30:59.875309 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-69b3dd5f-c6d2-4a95-846d-47649b7779c6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:30:59.893559 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-69b3dd5f-c6d2-4a95-846d-47649b7779c6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:59.894765 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-69b3dd5f-c6d2-4a95-846d-47649b7779c6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:59.897340 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-69b3dd5f-c6d2-4a95-846d-47649b7779c6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:30:59.898141 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-69b3dd5f-c6d2-4a95-846d-47649b7779c6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:30:59.972341 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=100 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:00.034345 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-d8a7c906-ff10-4af1-a3e1-3935f094b2db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:00.062868 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-d8a7c906-ff10-4af1-a3e1-3935f094b2db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1522 microversion: 2.1 time: 0.703727 Jun 21 18:31:00.078683 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-69b3dd5f-c6d2-4a95-846d-47649b7779c6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:00.088908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 100/192] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:59 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1522 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:00.096743 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-69b3dd5f-c6d2-4a95-846d-47649b7779c6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1218 microversion: 2.1 time: 0.230866 Jun 21 18:31:00.097887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 93/193] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:30:59 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1218 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:00.106021 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6ce3b5b6-84cd-4a72-b006-3209d85fad9f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:00.106021 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6ce3b5b6-84cd-4a72-b006-3209d85fad9f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:00.121111 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6ce3b5b6-84cd-4a72-b006-3209d85fad9f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:00.122078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6ce3b5b6-84cd-4a72-b006-3209d85fad9f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:00.123582 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6ce3b5b6-84cd-4a72-b006-3209d85fad9f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:00.124665 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6ce3b5b6-84cd-4a72-b006-3209d85fad9f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:00.151612 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-6ce3b5b6-84cd-4a72-b006-3209d85fad9f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] HTTP exception thrown: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6ce3b5b6-84cd-4a72-b006-3209d85fad9f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Request method failure captured: Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 HTTP/1.1 Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg4HE97WWfWlZ8oqZtAF-AamAMHA2qww7fGi7EqHrXInOoHUkuV7GvyQtg2RVpb9B9QbTJuZ4A_UROqug_5exvtFGy61QotFQV0fvv1AWd6bOPoV1TCoKarvSSv0hV-Ezz-ZhFipTGrrEWQShO40TxUxDnssTasBF0QjkK59JdC9MtU Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: ad7bfb54384a4d648245aaf12c05ade7 Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-DeleteServersTestJSON-2047425979 Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:31:00.172573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:31:00.175139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ad7bfb54384a4d648245aaf12c05ade7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ad7bfb54384a4d648245aaf12c05ade7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ad7bfb54384a4d648245aaf12c05ade7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ad7bfb54384a4d648245aaf12c05ade7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:31:00.175139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-DeleteServersTestJSON-2047425979 Jun 21 18:31:00.175139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: ad7bfb54384a4d648245aaf12c05ade7 Jun 21 18:31:00.175139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-DeleteServersTestJSON-2047425979 Jun 21 18:31:00.175139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-DeleteServersTestJSON-2047425979-project Jun 21 18:31:00.175139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:31:00.175139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:31:00.175139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: a03657e872e94266b12d95a602038cda Jun 21 18:31:00.175139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-DeleteServersTestJSON-2047425979-project Jun 21 18:31:00.175139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:31:00.175139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:00.175139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': '3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5'} Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:31:00.176780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:31:00.181148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:31:00.181148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:31:00.181148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:31:00.181148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:31:00.181148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:31:00.181148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:31:00.181148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:31:00.181148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:00.181148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:00.181148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:00.181148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:00.181148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:00.181148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:00.181148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:00.181148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:31:00.181148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:31:00.181148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:00.181148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:00.187199 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6ce3b5b6-84cd-4a72-b006-3209d85fad9f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Returning 404 to user: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:31:00.187199 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6ce3b5b6-84cd-4a72-b006-3209d85fad9f tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 404 len: 111 microversion: 2.1 time: 0.081738 Jun 21 18:31:00.187199 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 101/194] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:00 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:31:00.405044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-47a0e150-7c00-4055-b432-6e3160c553c6 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:00.407932 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-47a0e150-7c00-4055-b432-6e3160c553c6 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:00.420476 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-47a0e150-7c00-4055-b432-6e3160c553c6 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:00.421843 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-47a0e150-7c00-4055-b432-6e3160c553c6 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:00.424289 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-47a0e150-7c00-4055-b432-6e3160c553c6 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:00.424887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-47a0e150-7c00-4055-b432-6e3160c553c6 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:00.457353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-47a0e150-7c00-4055-b432-6e3160c553c6 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] HTTP exception thrown: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-47a0e150-7c00-4055-b432-6e3160c553c6 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Request method failure captured: Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5/os-volume_attachments HTTP/1.1 Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABisg4HE97WWfWlZ8oqZtAF-AamAMHA2qww7fGi7EqHrXInOoHUkuV7GvyQtg2RVpb9B9QbTJuZ4A_UROqug_5exvtFGy61QotFQV0fvv1AWd6bOPoV1TCoKarvSSv0hV-Ezz-ZhFipTGrrEWQShO40TxUxDnssTasBF0QjkK59JdC9MtU Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: ad7bfb54384a4d648245aaf12c05ade7 Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-DeleteServersTestJSON-2047425979 Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:31:00.471891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:31:00.474214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ad7bfb54384a4d648245aaf12c05ade7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ad7bfb54384a4d648245aaf12c05ade7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ad7bfb54384a4d648245aaf12c05ade7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ad7bfb54384a4d648245aaf12c05ade7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:31:00.474214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-DeleteServersTestJSON-2047425979 Jun 21 18:31:00.474214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: ad7bfb54384a4d648245aaf12c05ade7 Jun 21 18:31:00.474214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-DeleteServersTestJSON-2047425979 Jun 21 18:31:00.474214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-DeleteServersTestJSON-2047425979-project Jun 21 18:31:00.474214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:31:00.474214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:31:00.474214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: a03657e872e94266b12d95a602038cda Jun 21 18:31:00.474214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-DeleteServersTestJSON-2047425979-project Jun 21 18:31:00.474214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:31:00.474214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:00.474214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'server_id': '3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5'} Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:31:00.475365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:00.476770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:31:00.479830 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-47a0e150-7c00-4055-b432-6e3160c553c6 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Returning 404 to user: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:31:00.479830 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-47a0e150-7c00-4055-b432-6e3160c553c6 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.079890 Jun 21 18:31:00.479830 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 94/195] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:31:00 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5/os-volume_attachments => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:31:01.090760 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ace6b9a7-4cab-4a96-862b-221a91f1dd86 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:01.093007 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ace6b9a7-4cab-4a96-862b-221a91f1dd86 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:01.110468 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ace6b9a7-4cab-4a96-862b-221a91f1dd86 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:01.110947 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ace6b9a7-4cab-4a96-862b-221a91f1dd86 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:01.112190 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ace6b9a7-4cab-4a96-862b-221a91f1dd86 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:01.112627 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ace6b9a7-4cab-4a96-862b-221a91f1dd86 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:01.137073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c178ce13-7e3e-4b79-8bd3-09698d9032c6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:01.138235 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c178ce13-7e3e-4b79-8bd3-09698d9032c6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:01.165523 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c178ce13-7e3e-4b79-8bd3-09698d9032c6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:01.175833 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c178ce13-7e3e-4b79-8bd3-09698d9032c6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:01.178706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c178ce13-7e3e-4b79-8bd3-09698d9032c6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:01.179495 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c178ce13-7e3e-4b79-8bd3-09698d9032c6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:01.384542 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c178ce13-7e3e-4b79-8bd3-09698d9032c6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:01.408235 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c178ce13-7e3e-4b79-8bd3-09698d9032c6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1272 microversion: 2.1 time: 0.284588 Jun 21 18:31:01.418943 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 95/196] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:01 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1272 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:01.673341 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ace6b9a7-4cab-4a96-862b-221a91f1dd86 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:01.696198 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ace6b9a7-4cab-4a96-862b-221a91f1dd86 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1522 microversion: 2.1 time: 0.612270 Jun 21 18:31:01.698180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 102/197] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:01 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1522 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:01.989364 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d91adec1-bc48-4e03-9aec-dfb12129572b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:01.990546 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-d91adec1-bc48-4e03-9aec-dfb12129572b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:02.004967 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d91adec1-bc48-4e03-9aec-dfb12129572b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:02.006960 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d91adec1-bc48-4e03-9aec-dfb12129572b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:02.010821 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d91adec1-bc48-4e03-9aec-dfb12129572b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:02.012615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d91adec1-bc48-4e03-9aec-dfb12129572b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:02.053934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-d91adec1-bc48-4e03-9aec-dfb12129572b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] HTTP exception thrown: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d91adec1-bc48-4e03-9aec-dfb12129572b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Request method failure captured: Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: DELETE /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 HTTP/1.1 Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABisg4HE97WWfWlZ8oqZtAF-AamAMHA2qww7fGi7EqHrXInOoHUkuV7GvyQtg2RVpb9B9QbTJuZ4A_UROqug_5exvtFGy61QotFQV0fvv1AWd6bOPoV1TCoKarvSSv0hV-Ezz-ZhFipTGrrEWQShO40TxUxDnssTasBF0QjkK59JdC9MtU Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: ad7bfb54384a4d648245aaf12c05ade7 Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-DeleteServersTestJSON-2047425979 Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:31:02.059045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:31:02.061537 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ad7bfb54384a4d648245aaf12c05ade7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ad7bfb54384a4d648245aaf12c05ade7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ad7bfb54384a4d648245aaf12c05ade7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ad7bfb54384a4d648245aaf12c05ade7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:31:02.061537 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-DeleteServersTestJSON-2047425979 Jun 21 18:31:02.061537 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: ad7bfb54384a4d648245aaf12c05ade7 Jun 21 18:31:02.061537 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-DeleteServersTestJSON-2047425979 Jun 21 18:31:02.061537 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-DeleteServersTestJSON-2047425979-project Jun 21 18:31:02.061537 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:31:02.061537 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:31:02.061537 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: a03657e872e94266b12d95a602038cda Jun 21 18:31:02.061537 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-DeleteServersTestJSON-2047425979-project Jun 21 18:31:02.061537 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:31:02.061537 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:02.061537 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': '3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5'} Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:31:02.062887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:02.065253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:31:02.066831 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d91adec1-bc48-4e03-9aec-dfb12129572b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Returning 404 to user: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:31:02.066831 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-d91adec1-bc48-4e03-9aec-dfb12129572b tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "DELETE /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 404 len: 111 microversion: 2.1 time: 0.087513 Jun 21 18:31:02.066831 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 96/198] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:31:01 2022] DELETE /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:31:02.077775 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-45b40b21-f7d0-460c-9037-685d669af055 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:02.079007 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-45b40b21-f7d0-460c-9037-685d669af055 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] [instance: 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:02.089365 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-45b40b21-f7d0-460c-9037-685d669af055 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:02.090373 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-45b40b21-f7d0-460c-9037-685d669af055 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:02.091718 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-45b40b21-f7d0-460c-9037-685d669af055 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:02.093145 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-45b40b21-f7d0-460c-9037-685d669af055 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:02.130820 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-45b40b21-f7d0-460c-9037-685d669af055 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] HTTP exception thrown: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-45b40b21-f7d0-460c-9037-685d669af055 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Request method failure captured: Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 HTTP/1.1 Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg4HE97WWfWlZ8oqZtAF-AamAMHA2qww7fGi7EqHrXInOoHUkuV7GvyQtg2RVpb9B9QbTJuZ4A_UROqug_5exvtFGy61QotFQV0fvv1AWd6bOPoV1TCoKarvSSv0hV-Ezz-ZhFipTGrrEWQShO40TxUxDnssTasBF0QjkK59JdC9MtU Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: ad7bfb54384a4d648245aaf12c05ade7 Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-DeleteServersTestJSON-2047425979 Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:31:02.134065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:31:02.136463 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ad7bfb54384a4d648245aaf12c05ade7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/ad7bfb54384a4d648245aaf12c05ade7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/ad7bfb54384a4d648245aaf12c05ade7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_ad7bfb54384a4d648245aaf12c05ade7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:31:02.136463 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-DeleteServersTestJSON-2047425979 Jun 21 18:31:02.136463 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: ad7bfb54384a4d648245aaf12c05ade7 Jun 21 18:31:02.136463 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-DeleteServersTestJSON-2047425979 Jun 21 18:31:02.136463 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-DeleteServersTestJSON-2047425979-project Jun 21 18:31:02.136463 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:31:02.136463 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:31:02.136463 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: a03657e872e94266b12d95a602038cda Jun 21 18:31:02.136463 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-DeleteServersTestJSON-2047425979-project Jun 21 18:31:02.136463 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:31:02.136463 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:02.136463 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': '3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5'} Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:31:02.137618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:31:02.139900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:31:02.139900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:31:02.139900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:31:02.139900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:31:02.139900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:31:02.139900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:31:02.139900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:31:02.139900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:02.139900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:02.139900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:02.139900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:02.139900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:02.139900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:02.139900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:02.139900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:31:02.139900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:31:02.139900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. Jun 21 18:31:02.139900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:02.143755 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-45b40b21-f7d0-460c-9037-685d669af055 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] Returning 404 to user: Instance 3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:31:02.145457 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-45b40b21-f7d0-460c-9037-685d669af055 tempest-DeleteServersTestJSON-2047425979 tempest-DeleteServersTestJSON-2047425979-project] 10.222.0.87 "GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5" status: 404 len: 111 microversion: 2.1 time: 0.074649 Jun 21 18:31:02.147142 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 103/199] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:02 2022] GET /compute/v2.1/servers/3622f2e4-0bdb-4889-b3ec-5faf6e1cfca5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 18:31:02.443189 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-dcb002a9-d6ac-4ab5-a415-5ce547bb501e tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:02.444545 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-dcb002a9-d6ac-4ab5-a415-5ce547bb501e tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:02.456755 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dcb002a9-d6ac-4ab5-a415-5ce547bb501e tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:02.457512 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dcb002a9-d6ac-4ab5-a415-5ce547bb501e tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:02.458864 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dcb002a9-d6ac-4ab5-a415-5ce547bb501e tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:02.459662 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dcb002a9-d6ac-4ab5-a415-5ce547bb501e tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:02.722612 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a827d2da-00ce-4d0e-a096-2d1ca9c159a7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:02.723831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-a827d2da-00ce-4d0e-a096-2d1ca9c159a7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:02.743292 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a827d2da-00ce-4d0e-a096-2d1ca9c159a7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:02.745619 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a827d2da-00ce-4d0e-a096-2d1ca9c159a7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:02.747278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a827d2da-00ce-4d0e-a096-2d1ca9c159a7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:02.748231 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a827d2da-00ce-4d0e-a096-2d1ca9c159a7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:03.153671 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-dcb002a9-d6ac-4ab5-a415-5ce547bb501e tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:03.186943 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-dcb002a9-d6ac-4ab5-a415-5ce547bb501e tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1314 microversion: 2.1 time: 0.746094 Jun 21 18:31:03.188240 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 97/200] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:02 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:03.372276 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-a827d2da-00ce-4d0e-a096-2d1ca9c159a7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:03.398020 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-a827d2da-00ce-4d0e-a096-2d1ca9c159a7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1522 microversion: 2.1 time: 0.681403 Jun 21 18:31:03.398929 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 104/201] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:02 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1522 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:04.217081 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5ebc3dd6-44a6-449f-a25e-c70c4417b505 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:04.220474 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-5ebc3dd6-44a6-449f-a25e-c70c4417b505 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:04.259397 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5ebc3dd6-44a6-449f-a25e-c70c4417b505 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:04.264931 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5ebc3dd6-44a6-449f-a25e-c70c4417b505 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:04.268809 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5ebc3dd6-44a6-449f-a25e-c70c4417b505 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:04.269821 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5ebc3dd6-44a6-449f-a25e-c70c4417b505 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:04.423743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c7146458-4dcc-4812-b983-18656eba9edb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:04.424459 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c7146458-4dcc-4812-b983-18656eba9edb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:04.441378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c7146458-4dcc-4812-b983-18656eba9edb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:04.449533 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c7146458-4dcc-4812-b983-18656eba9edb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:04.452606 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c7146458-4dcc-4812-b983-18656eba9edb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:04.453696 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c7146458-4dcc-4812-b983-18656eba9edb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:04.914484 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-5ebc3dd6-44a6-449f-a25e-c70c4417b505 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:04.935599 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-5ebc3dd6-44a6-449f-a25e-c70c4417b505 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1314 microversion: 2.1 time: 0.724607 Jun 21 18:31:04.937799 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 98/202] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:04 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1314 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:05.095266 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c7146458-4dcc-4812-b983-18656eba9edb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:05.114447 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c7146458-4dcc-4812-b983-18656eba9edb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1522 microversion: 2.1 time: 0.698105 Jun 21 18:31:05.131055 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 105/203] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:04 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1522 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:05.496700 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-a5893348-7959-4734-8b39-bad864627f1d req-60f3cb39-e1d3-45ed-b27d-2fe6680dbff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37994aca-0c56-441a-a9f4-740d241ef940", "tag": "b41d930a-b63e-473c-9683-a53a13d4c88f"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:05.515351 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-a5893348-7959-4734-8b39-bad864627f1d req-60f3cb39-e1d3-45ed-b27d-2fe6680dbff4 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:05.516474 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-a5893348-7959-4734-8b39-bad864627f1d req-60f3cb39-e1d3-45ed-b27d-2fe6680dbff4 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:05.537932 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-a5893348-7959-4734-8b39-bad864627f1d req-60f3cb39-e1d3-45ed-b27d-2fe6680dbff4 service nova] Creating event network-changed:b41d930a-b63e-473c-9683-a53a13d4c88f for instance 37994aca-0c56-441a-a9f4-740d241ef940 on hv-cinder-84460 Jun 21 18:31:05.544855 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-a5893348-7959-4734-8b39-bad864627f1d req-60f3cb39-e1d3-45ed-b27d-2fe6680dbff4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053703 Jun 21 18:31:05.547500 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 99/204] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:31:05.969320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6b424698-0730-4179-a2ad-378bafda59cd tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:05.971882 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6b424698-0730-4179-a2ad-378bafda59cd tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:05.983120 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6b424698-0730-4179-a2ad-378bafda59cd tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:05.984279 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6b424698-0730-4179-a2ad-378bafda59cd tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:05.986081 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6b424698-0730-4179-a2ad-378bafda59cd tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:05.987033 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6b424698-0730-4179-a2ad-378bafda59cd tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:06.146451 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5fd404a7-0906-4b5b-8cfa-a03f7befb531 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:06.148121 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-5fd404a7-0906-4b5b-8cfa-a03f7befb531 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:06.164502 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5fd404a7-0906-4b5b-8cfa-a03f7befb531 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:06.166048 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5fd404a7-0906-4b5b-8cfa-a03f7befb531 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:06.168152 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5fd404a7-0906-4b5b-8cfa-a03f7befb531 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:06.169558 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5fd404a7-0906-4b5b-8cfa-a03f7befb531 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:07.327673 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-6b424698-0730-4179-a2ad-378bafda59cd tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:07.340301 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6b424698-0730-4179-a2ad-378bafda59cd tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1314 microversion: 2.1 time: 1.380090 Jun 21 18:31:07.344178 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 106/205] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:05 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1314 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:07.599421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-5fd404a7-0906-4b5b-8cfa-a03f7befb531 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:07.634873 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-5fd404a7-0906-4b5b-8cfa-a03f7befb531 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1502 microversion: 2.1 time: 1.495339 Jun 21 18:31:07.637487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 100/206] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:06 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1502 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:07.673288 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ac7a14cf-e26b-4562-8e45-f1b64b59463a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:07.676191 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ac7a14cf-e26b-4562-8e45-f1b64b59463a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:07.692528 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ac7a14cf-e26b-4562-8e45-f1b64b59463a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:07.694011 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ac7a14cf-e26b-4562-8e45-f1b64b59463a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:07.695836 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ac7a14cf-e26b-4562-8e45-f1b64b59463a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:07.697911 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ac7a14cf-e26b-4562-8e45-f1b64b59463a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:08.372400 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f2e76868-246d-4425-beb7-f352ddec1dc3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:08.373681 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f2e76868-246d-4425-beb7-f352ddec1dc3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:08.382164 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=2 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:08.392636 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f2e76868-246d-4425-beb7-f352ddec1dc3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:08.393164 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f2e76868-246d-4425-beb7-f352ddec1dc3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:08.396429 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f2e76868-246d-4425-beb7-f352ddec1dc3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:08.397317 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f2e76868-246d-4425-beb7-f352ddec1dc3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:08.476551 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=6 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:08.549035 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ac7a14cf-e26b-4562-8e45-f1b64b59463a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:08.569596 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ac7a14cf-e26b-4562-8e45-f1b64b59463a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1516 microversion: 2.1 time: 0.916325 Jun 21 18:31:08.571323 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 107/207] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:07 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1516 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:09.535209 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f2e76868-246d-4425-beb7-f352ddec1dc3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:09.551068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f2e76868-246d-4425-beb7-f352ddec1dc3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1314 microversion: 2.1 time: 1.185279 Jun 21 18:31:09.556359 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 101/208] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:08 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1314 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:10.571278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=2 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:10.580018 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e6db8995-a66d-4ddc-a5d5-a35d240513f3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:10.581248 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e6db8995-a66d-4ddc-a5d5-a35d240513f3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:10.593523 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e6db8995-a66d-4ddc-a5d5-a35d240513f3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:10.594349 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e6db8995-a66d-4ddc-a5d5-a35d240513f3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:10.595757 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e6db8995-a66d-4ddc-a5d5-a35d240513f3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:10.596506 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e6db8995-a66d-4ddc-a5d5-a35d240513f3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:11.009258 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e6db8995-a66d-4ddc-a5d5-a35d240513f3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:11.028284 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e6db8995-a66d-4ddc-a5d5-a35d240513f3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1314 microversion: 2.1 time: 0.457208 Jun 21 18:31:11.031631 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 108/209] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:10 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:12.058222 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-9a23e903-e4e1-4671-bb03-e4ebc3626a3b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:12.059300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-9a23e903-e4e1-4671-bb03-e4ebc3626a3b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:12.079103 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-04d23f17-d126-4056-bba6-e5aa6c5dbb26 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:12.081697 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-04d23f17-d126-4056-bba6-e5aa6c5dbb26 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:12.086253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9a23e903-e4e1-4671-bb03-e4ebc3626a3b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:12.086542 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9a23e903-e4e1-4671-bb03-e4ebc3626a3b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:12.094016 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9a23e903-e4e1-4671-bb03-e4ebc3626a3b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:12.094831 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9a23e903-e4e1-4671-bb03-e4ebc3626a3b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:12.096595 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-04d23f17-d126-4056-bba6-e5aa6c5dbb26 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:12.098084 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-04d23f17-d126-4056-bba6-e5aa6c5dbb26 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:12.099558 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-04d23f17-d126-4056-bba6-e5aa6c5dbb26 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:12.100328 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-04d23f17-d126-4056-bba6-e5aa6c5dbb26 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:12.147365 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:12.158089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.objects.instance [None req-04d23f17-d126-4056-bba6-e5aa6c5dbb26 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lazy-loading 'flavor' on Instance uuid c3e33553-dc4c-4e34-8533-beea14017592 {{(pid=118109) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:31:12.424906 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-04d23f17-d126-4056-bba6-e5aa6c5dbb26 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "POST /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592/action" status: 200 len: 32 microversion: 2.1 time: 0.354283 Jun 21 18:31:12.437112 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 109/210] 10.222.0.87 () {60 vars in 1277 bytes} [Tue Jun 21 18:31:12 2022] POST /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592/action => generated 32 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 18:31:12.453335 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b7451a59-e240-47a5-b2e2-eb604b63666c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:12.457016 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b7451a59-e240-47a5-b2e2-eb604b63666c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:12.471703 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b7451a59-e240-47a5-b2e2-eb604b63666c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:12.472041 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-9a23e903-e4e1-4671-bb03-e4ebc3626a3b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:12.472340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b7451a59-e240-47a5-b2e2-eb604b63666c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:12.474078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b7451a59-e240-47a5-b2e2-eb604b63666c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:12.475484 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b7451a59-e240-47a5-b2e2-eb604b63666c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:12.483608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-9a23e903-e4e1-4671-bb03-e4ebc3626a3b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1314 microversion: 2.1 time: 0.432351 Jun 21 18:31:12.498013 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 102/211] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:12 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:12.758215 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b7451a59-e240-47a5-b2e2-eb604b63666c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:12.803698 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b7451a59-e240-47a5-b2e2-eb604b63666c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1522 microversion: 2.1 time: 0.360361 Jun 21 18:31:12.806805 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 110/212] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:12 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:13.524175 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-9f8bbe8e-a229-4620-88d4-7418f440019b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:13.527063 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-9f8bbe8e-a229-4620-88d4-7418f440019b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:13.557662 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9f8bbe8e-a229-4620-88d4-7418f440019b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:13.560698 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9f8bbe8e-a229-4620-88d4-7418f440019b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:13.564149 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9f8bbe8e-a229-4620-88d4-7418f440019b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:13.568384 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9f8bbe8e-a229-4620-88d4-7418f440019b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:13.833843 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-845d225c-986f-4a3e-ac03-1ab8a973564a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:13.836486 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-845d225c-986f-4a3e-ac03-1ab8a973564a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:13.864120 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-845d225c-986f-4a3e-ac03-1ab8a973564a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:13.868656 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-845d225c-986f-4a3e-ac03-1ab8a973564a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:13.873495 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-845d225c-986f-4a3e-ac03-1ab8a973564a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:13.876289 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-845d225c-986f-4a3e-ac03-1ab8a973564a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:14.708062 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-9f8bbe8e-a229-4620-88d4-7418f440019b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:14.732849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-9f8bbe8e-a229-4620-88d4-7418f440019b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1314 microversion: 2.1 time: 1.221389 Jun 21 18:31:14.734235 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 103/213] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:13 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1314 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:14.876892 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-845d225c-986f-4a3e-ac03-1ab8a973564a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:14.908242 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-845d225c-986f-4a3e-ac03-1ab8a973564a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1522 microversion: 2.1 time: 1.081305 Jun 21 18:31:14.910019 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 111/214] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:13 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1522 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:15.763354 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5e794a4b-7f4d-475f-984b-5cfd003155b0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:15.763354 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-5e794a4b-7f4d-475f-984b-5cfd003155b0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:15.776418 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5e794a4b-7f4d-475f-984b-5cfd003155b0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:15.777722 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5e794a4b-7f4d-475f-984b-5cfd003155b0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:15.780263 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5e794a4b-7f4d-475f-984b-5cfd003155b0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:15.781228 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5e794a4b-7f4d-475f-984b-5cfd003155b0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:15.946662 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f9f1e057-18f0-4e11-8937-a9407d72596c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:15.949591 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f9f1e057-18f0-4e11-8937-a9407d72596c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:15.971312 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f9f1e057-18f0-4e11-8937-a9407d72596c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:15.971312 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f9f1e057-18f0-4e11-8937-a9407d72596c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:15.978615 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f9f1e057-18f0-4e11-8937-a9407d72596c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:15.979996 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f9f1e057-18f0-4e11-8937-a9407d72596c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:16.154378 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-5e794a4b-7f4d-475f-984b-5cfd003155b0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:16.164255 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-5e794a4b-7f4d-475f-984b-5cfd003155b0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1314 microversion: 2.1 time: 0.408716 Jun 21 18:31:16.165195 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 104/215] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:15 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:16.394608 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f9f1e057-18f0-4e11-8937-a9407d72596c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:16.420836 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f9f1e057-18f0-4e11-8937-a9407d72596c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1522 microversion: 2.1 time: 0.489593 Jun 21 18:31:16.436587 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 112/216] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:15 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:16.535645 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-41ee3452-b86a-4ebd-b7ad-114d81173373 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-107495989", "imageRef": "c28659fb-c2d3-4dda-a330-1323a974987e", "flavorRef": "452", "networks": [{"uuid": "38a1b177-7269-4848-b0d6-5aa065bd4bbf"}]}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:16.678301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.network.neutron [None req-41ee3452-b86a-4ebd-b7ad-114d81173373 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] validate_networks() for [('38a1b177-7269-4848-b0d6-5aa065bd4bbf', None, None, None, None, None)] {{(pid=118108) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:31:17.193909 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-302a67ca-b00b-4209-95ef-56ae94dd8372 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:17.194935 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-302a67ca-b00b-4209-95ef-56ae94dd8372 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:17.206320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-302a67ca-b00b-4209-95ef-56ae94dd8372 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:17.207052 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-302a67ca-b00b-4209-95ef-56ae94dd8372 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:17.208675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-302a67ca-b00b-4209-95ef-56ae94dd8372 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:17.209628 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-302a67ca-b00b-4209-95ef-56ae94dd8372 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:17.647397 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-302a67ca-b00b-4209-95ef-56ae94dd8372 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:17.665213 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-41ee3452-b86a-4ebd-b7ad-114d81173373 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Flavor limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:31:17.666513 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-41ee3452-b86a-4ebd-b7ad-114d81173373 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Image limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:31:17.667269 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-41ee3452-b86a-4ebd-b7ad-114d81173373 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Flavor pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:31:17.667892 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-41ee3452-b86a-4ebd-b7ad-114d81173373 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Image pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:31:17.668532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-41ee3452-b86a-4ebd-b7ad-114d81173373 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:31:17.682524 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-302a67ca-b00b-4209-95ef-56ae94dd8372 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1314 microversion: 2.1 time: 0.495113 Jun 21 18:31:17.690142 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 113/217] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:17 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:17.691305 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-41ee3452-b86a-4ebd-b7ad-114d81173373 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:17.692566 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-41ee3452-b86a-4ebd-b7ad-114d81173373 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:17.694027 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-41ee3452-b86a-4ebd-b7ad-114d81173373 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:17.695049 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-41ee3452-b86a-4ebd-b7ad-114d81173373 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:17.718326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-657ca168-86c5-48ed-9c55-12b7ea62dccd tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:17.719077 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-657ca168-86c5-48ed-9c55-12b7ea62dccd tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:17.733428 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-41ee3452-b86a-4ebd-b7ad-114d81173373 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Getting quotas for project 55c4efeea2f54994b6f45b5cc346c43b. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:31:17.738384 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-657ca168-86c5-48ed-9c55-12b7ea62dccd tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:17.739162 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-657ca168-86c5-48ed-9c55-12b7ea62dccd tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:17.740110 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-657ca168-86c5-48ed-9c55-12b7ea62dccd tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:17.740698 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-41ee3452-b86a-4ebd-b7ad-114d81173373 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Getting quotas for user ec179985fc3b41d188ca69d9e03263d0 and project 55c4efeea2f54994b6f45b5cc346c43b. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:31:17.740820 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-657ca168-86c5-48ed-9c55-12b7ea62dccd tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:17.771556 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-41ee3452-b86a-4ebd-b7ad-114d81173373 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Going to run 1 instances... {{(pid=118108) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:31:17.779618 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-41ee3452-b86a-4ebd-b7ad-114d81173373 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c28659fb-c2d3-4dda-a330-1323a974987e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118108) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:31:17.959938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-41ee3452-b86a-4ebd-b7ad-114d81173373 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.428462 Jun 21 18:31:17.968558 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 105/218] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:31:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:31:17.987100 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-14ba0fb3-da8c-4ee2-ab9b-61f2548c3547 req-66bc771c-b3ab-4df0-9143-6a602d6f6e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37994aca-0c56-441a-a9f4-740d241ef940", "name": "network-vif-plugged", "status": "completed", "tag": "b41d930a-b63e-473c-9683-a53a13d4c88f"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:18.022383 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-14ba0fb3-da8c-4ee2-ab9b-61f2548c3547 req-66bc771c-b3ab-4df0-9143-6a602d6f6e7b service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:18.025330 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-14ba0fb3-da8c-4ee2-ab9b-61f2548c3547 req-66bc771c-b3ab-4df0-9143-6a602d6f6e7b service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:18.068606 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-14ba0fb3-da8c-4ee2-ab9b-61f2548c3547 req-66bc771c-b3ab-4df0-9143-6a602d6f6e7b service nova] Creating event network-vif-plugged:b41d930a-b63e-473c-9683-a53a13d4c88f for instance 37994aca-0c56-441a-a9f4-740d241ef940 on hv-cinder-84460 Jun 21 18:31:18.084083 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-14ba0fb3-da8c-4ee2-ab9b-61f2548c3547 req-66bc771c-b3ab-4df0-9143-6a602d6f6e7b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113352 Jun 21 18:31:18.091774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 106/219] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:31:18.121076 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-111c453d-0e9b-4ed5-831d-150a509a11e8 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:18.124306 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-111c453d-0e9b-4ed5-831d-150a509a11e8 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:18.165778 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-657ca168-86c5-48ed-9c55-12b7ea62dccd tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:18.182398 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-657ca168-86c5-48ed-9c55-12b7ea62dccd tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1522 microversion: 2.1 time: 0.490757 Jun 21 18:31:18.201215 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 114/220] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:17 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1522 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:18.332583 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-111c453d-0e9b-4ed5-831d-150a509a11e8 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:18.373929 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-111c453d-0e9b-4ed5-831d-150a509a11e8 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1218 microversion: 2.1 time: 0.277519 Jun 21 18:31:18.374492 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 107/221] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:18 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1218 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:18.730930 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-97adc78b-4882-4988-a3dd-a5951c1c6070 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:18.735702 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-97adc78b-4882-4988-a3dd-a5951c1c6070 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:18.791420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-97adc78b-4882-4988-a3dd-a5951c1c6070 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:18.796031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-97adc78b-4882-4988-a3dd-a5951c1c6070 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:18.803404 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-97adc78b-4882-4988-a3dd-a5951c1c6070 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:18.804764 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-97adc78b-4882-4988-a3dd-a5951c1c6070 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:19.210828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d70665d5-efbd-4c82-864a-bd12e2573708 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:19.211783 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-d70665d5-efbd-4c82-864a-bd12e2573708 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:19.226866 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-97adc78b-4882-4988-a3dd-a5951c1c6070 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:19.228870 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d70665d5-efbd-4c82-864a-bd12e2573708 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:19.230309 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d70665d5-efbd-4c82-864a-bd12e2573708 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:19.233328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d70665d5-efbd-4c82-864a-bd12e2573708 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:19.235069 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d70665d5-efbd-4c82-864a-bd12e2573708 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:19.248578 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-97adc78b-4882-4988-a3dd-a5951c1c6070 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1314 microversion: 2.1 time: 0.533845 Jun 21 18:31:19.250645 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 115/222] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:18 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:19.409456 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1d85ddb8-0024-404f-8bc7-8d861ffc70c4 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:19.410560 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1d85ddb8-0024-404f-8bc7-8d861ffc70c4 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:19.433143 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1d85ddb8-0024-404f-8bc7-8d861ffc70c4 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:19.434916 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1d85ddb8-0024-404f-8bc7-8d861ffc70c4 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:19.439375 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1d85ddb8-0024-404f-8bc7-8d861ffc70c4 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:19.441337 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1d85ddb8-0024-404f-8bc7-8d861ffc70c4 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:19.522569 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-d70665d5-efbd-4c82-864a-bd12e2573708 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:19.549382 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-d70665d5-efbd-4c82-864a-bd12e2573708 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1522 microversion: 2.1 time: 0.347329 Jun 21 18:31:19.557600 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 108/223] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:19 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:19.609761 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1d85ddb8-0024-404f-8bc7-8d861ffc70c4 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:19.626482 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1d85ddb8-0024-404f-8bc7-8d861ffc70c4 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1222 microversion: 2.1 time: 0.228767 Jun 21 18:31:19.627474 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 116/224] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:19 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1222 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:20.291946 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-863fb2b5-b08b-465c-a6e1-ce294c484bce tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:20.291946 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-863fb2b5-b08b-465c-a6e1-ce294c484bce tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:20.296757 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:20.310527 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-863fb2b5-b08b-465c-a6e1-ce294c484bce tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:20.311665 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-863fb2b5-b08b-465c-a6e1-ce294c484bce tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:20.313515 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-863fb2b5-b08b-465c-a6e1-ce294c484bce tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:20.315282 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-863fb2b5-b08b-465c-a6e1-ce294c484bce tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:20.582455 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-0040ac30-c6b7-4d73-bb79-1d6c47768f46 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:20.584489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-0040ac30-c6b7-4d73-bb79-1d6c47768f46 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:20.604232 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0040ac30-c6b7-4d73-bb79-1d6c47768f46 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:20.608363 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0040ac30-c6b7-4d73-bb79-1d6c47768f46 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:20.611845 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0040ac30-c6b7-4d73-bb79-1d6c47768f46 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:20.615868 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0040ac30-c6b7-4d73-bb79-1d6c47768f46 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:20.747526 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-863fb2b5-b08b-465c-a6e1-ce294c484bce tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:20.778822 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-863fb2b5-b08b-465c-a6e1-ce294c484bce tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1314 microversion: 2.1 time: 0.497414 Jun 21 18:31:20.794835 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 109/225] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:20 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:20.816595 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f0ee597c-4a29-46ca-901f-eb231660fb00 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:20.818134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f0ee597c-4a29-46ca-901f-eb231660fb00 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:20.859932 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f0ee597c-4a29-46ca-901f-eb231660fb00 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:20.862882 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f0ee597c-4a29-46ca-901f-eb231660fb00 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:20.868704 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f0ee597c-4a29-46ca-901f-eb231660fb00 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:20.874550 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f0ee597c-4a29-46ca-901f-eb231660fb00 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:21.040877 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f0ee597c-4a29-46ca-901f-eb231660fb00 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:21.059283 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f0ee597c-4a29-46ca-901f-eb231660fb00 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1270 microversion: 2.1 time: 0.262114 Jun 21 18:31:21.062179 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 110/226] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:20 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1270 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:21.138187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-0040ac30-c6b7-4d73-bb79-1d6c47768f46 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:21.148943 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-0040ac30-c6b7-4d73-bb79-1d6c47768f46 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1522 microversion: 2.1 time: 0.571311 Jun 21 18:31:21.150368 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 117/227] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:20 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1522 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:21.810141 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-01f4af23-7b12-4f2f-9bbc-7fc149713b75 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:21.812141 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-01f4af23-7b12-4f2f-9bbc-7fc149713b75 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:21.823089 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-01f4af23-7b12-4f2f-9bbc-7fc149713b75 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:21.824228 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-01f4af23-7b12-4f2f-9bbc-7fc149713b75 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:21.825571 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-01f4af23-7b12-4f2f-9bbc-7fc149713b75 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:21.826736 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-01f4af23-7b12-4f2f-9bbc-7fc149713b75 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:22.100551 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b4e5b6ec-ed41-4fb5-9a9e-85463fa01bd5 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:22.106661 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b4e5b6ec-ed41-4fb5-9a9e-85463fa01bd5 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:22.123427 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b4e5b6ec-ed41-4fb5-9a9e-85463fa01bd5 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:22.124675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b4e5b6ec-ed41-4fb5-9a9e-85463fa01bd5 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:22.126262 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b4e5b6ec-ed41-4fb5-9a9e-85463fa01bd5 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:22.127501 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b4e5b6ec-ed41-4fb5-9a9e-85463fa01bd5 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:22.162946 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-01f4af23-7b12-4f2f-9bbc-7fc149713b75 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:22.176119 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-01f4af23-7b12-4f2f-9bbc-7fc149713b75 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1498 microversion: 2.1 time: 0.370292 Jun 21 18:31:22.182016 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 111/228] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:21 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1498 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:22.190740 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-24804fcd-8d43-4709-b885-0d614215a5db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:22.200985 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-24804fcd-8d43-4709-b885-0d614215a5db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:22.221480 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-24804fcd-8d43-4709-b885-0d614215a5db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:22.226153 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-24804fcd-8d43-4709-b885-0d614215a5db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:22.228196 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-24804fcd-8d43-4709-b885-0d614215a5db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:22.234894 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-24804fcd-8d43-4709-b885-0d614215a5db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:22.360139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b4e5b6ec-ed41-4fb5-9a9e-85463fa01bd5 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:22.380712 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b4e5b6ec-ed41-4fb5-9a9e-85463fa01bd5 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1276 microversion: 2.1 time: 0.295741 Jun 21 18:31:22.404298 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 118/229] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:22 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1276 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:22.634940 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-24804fcd-8d43-4709-b885-0d614215a5db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:22.662946 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-24804fcd-8d43-4709-b885-0d614215a5db tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1522 microversion: 2.1 time: 0.478346 Jun 21 18:31:22.664906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 112/230] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:22 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1522 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:23.415006 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8ba7d0c9-973a-4d83-95f6-551b3c5a4c24 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:23.415864 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8ba7d0c9-973a-4d83-95f6-551b3c5a4c24 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:23.424022 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8ba7d0c9-973a-4d83-95f6-551b3c5a4c24 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:23.424828 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8ba7d0c9-973a-4d83-95f6-551b3c5a4c24 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:23.425853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8ba7d0c9-973a-4d83-95f6-551b3c5a4c24 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:23.426412 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8ba7d0c9-973a-4d83-95f6-551b3c5a4c24 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:23.694564 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-fa58e809-9db9-44f9-966d-04a3ec70a793 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:23.695877 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-fa58e809-9db9-44f9-966d-04a3ec70a793 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:23.706805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fa58e809-9db9-44f9-966d-04a3ec70a793 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:23.707636 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fa58e809-9db9-44f9-966d-04a3ec70a793 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:23.708701 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fa58e809-9db9-44f9-966d-04a3ec70a793 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:23.709613 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fa58e809-9db9-44f9-966d-04a3ec70a793 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:23.804743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-8ba7d0c9-973a-4d83-95f6-551b3c5a4c24 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:23.813940 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8ba7d0c9-973a-4d83-95f6-551b3c5a4c24 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1318 microversion: 2.1 time: 0.403119 Jun 21 18:31:23.815236 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 119/231] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:23 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:24.016877 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-fa58e809-9db9-44f9-966d-04a3ec70a793 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:24.037975 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-fa58e809-9db9-44f9-966d-04a3ec70a793 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1522 microversion: 2.1 time: 0.347416 Jun 21 18:31:24.054796 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 113/232] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:23 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:24.339522 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-51086de6-17d6-4597-af31-d92a8dac57e6 req-83630033-aa9f-4fcf-8ac0-839cebada4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38292b40-45ba-4fe8-afa4-b0d3844b87c3", "tag": "0945feb3-aa60-4570-a771-8886a7667bfc"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:24.350832 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-51086de6-17d6-4597-af31-d92a8dac57e6 req-83630033-aa9f-4fcf-8ac0-839cebada4a0 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:24.351876 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-51086de6-17d6-4597-af31-d92a8dac57e6 req-83630033-aa9f-4fcf-8ac0-839cebada4a0 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:24.580143 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-51086de6-17d6-4597-af31-d92a8dac57e6 req-83630033-aa9f-4fcf-8ac0-839cebada4a0 service nova] Creating event network-changed:0945feb3-aa60-4570-a771-8886a7667bfc for instance 38292b40-45ba-4fe8-afa4-b0d3844b87c3 on hv-cinder-84460 Jun 21 18:31:24.589283 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-51086de6-17d6-4597-af31-d92a8dac57e6 req-83630033-aa9f-4fcf-8ac0-839cebada4a0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.255788 Jun 21 18:31:24.590066 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 120/233] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:31:24.852379 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5eeafebf-912a-4212-bd03-c5e9137cd261 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:24.853249 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-5eeafebf-912a-4212-bd03-c5e9137cd261 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:24.862553 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5eeafebf-912a-4212-bd03-c5e9137cd261 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:24.863077 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5eeafebf-912a-4212-bd03-c5e9137cd261 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:24.864165 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5eeafebf-912a-4212-bd03-c5e9137cd261 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:24.864724 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5eeafebf-912a-4212-bd03-c5e9137cd261 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:24.869168 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=100 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:25.072917 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-5eeafebf-912a-4212-bd03-c5e9137cd261 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:25.074510 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8874d229-0b2b-4593-a793-be544ed5b750 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:25.077513 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8874d229-0b2b-4593-a793-be544ed5b750 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:25.087377 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-5eeafebf-912a-4212-bd03-c5e9137cd261 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1318 microversion: 2.1 time: 0.240398 Jun 21 18:31:25.099201 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 114/234] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:24 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:25.099449 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8874d229-0b2b-4593-a793-be544ed5b750 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:25.099449 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8874d229-0b2b-4593-a793-be544ed5b750 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:25.099449 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8874d229-0b2b-4593-a793-be544ed5b750 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:25.099449 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8874d229-0b2b-4593-a793-be544ed5b750 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:25.352866 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-8874d229-0b2b-4593-a793-be544ed5b750 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:25.369391 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8874d229-0b2b-4593-a793-be544ed5b750 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1522 microversion: 2.1 time: 0.305081 Jun 21 18:31:25.371034 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 121/235] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:25 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:26.112741 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-89d3c28e-ec04-4d13-a48f-67914ccdda7b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:26.113892 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-89d3c28e-ec04-4d13-a48f-67914ccdda7b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:26.128045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-89d3c28e-ec04-4d13-a48f-67914ccdda7b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:26.128045 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-89d3c28e-ec04-4d13-a48f-67914ccdda7b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:26.130046 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-89d3c28e-ec04-4d13-a48f-67914ccdda7b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:26.130046 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-89d3c28e-ec04-4d13-a48f-67914ccdda7b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:26.335096 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-89d3c28e-ec04-4d13-a48f-67914ccdda7b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:26.346428 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-89d3c28e-ec04-4d13-a48f-67914ccdda7b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1318 microversion: 2.1 time: 0.242754 Jun 21 18:31:26.347024 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 115/236] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:26 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:26.406743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f7985b13-4835-404d-8b98-894ed75241c1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:26.409936 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f7985b13-4835-404d-8b98-894ed75241c1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:26.415181 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=54 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:26.427173 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7985b13-4835-404d-8b98-894ed75241c1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:26.429670 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7985b13-4835-404d-8b98-894ed75241c1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:26.431361 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7985b13-4835-404d-8b98-894ed75241c1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:26.432339 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7985b13-4835-404d-8b98-894ed75241c1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:26.631797 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f7985b13-4835-404d-8b98-894ed75241c1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:26.647217 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f7985b13-4835-404d-8b98-894ed75241c1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1522 microversion: 2.1 time: 0.247752 Jun 21 18:31:26.648774 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 122/237] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:26 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:27.375222 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6af1a0d6-27e4-475e-95d9-1c2b0b96d3da tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:27.376199 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-6af1a0d6-27e4-475e-95d9-1c2b0b96d3da tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:27.384557 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6af1a0d6-27e4-475e-95d9-1c2b0b96d3da tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:27.385112 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6af1a0d6-27e4-475e-95d9-1c2b0b96d3da tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:27.386216 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6af1a0d6-27e4-475e-95d9-1c2b0b96d3da tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:27.386754 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6af1a0d6-27e4-475e-95d9-1c2b0b96d3da tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:27.679450 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-4665fd0d-0fe9-497a-9dda-3d97c587883c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:27.681933 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-4665fd0d-0fe9-497a-9dda-3d97c587883c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:27.694908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4665fd0d-0fe9-497a-9dda-3d97c587883c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:27.695720 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4665fd0d-0fe9-497a-9dda-3d97c587883c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:27.697146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4665fd0d-0fe9-497a-9dda-3d97c587883c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:27.697953 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4665fd0d-0fe9-497a-9dda-3d97c587883c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:27.711411 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6af1a0d6-27e4-475e-95d9-1c2b0b96d3da tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:27.730148 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=2 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:27.736071 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6af1a0d6-27e4-475e-95d9-1c2b0b96d3da tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1318 microversion: 2.1 time: 0.369946 Jun 21 18:31:27.754605 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 116/238] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:27 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:28.019561 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-4665fd0d-0fe9-497a-9dda-3d97c587883c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:28.053684 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-4665fd0d-0fe9-497a-9dda-3d97c587883c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1522 microversion: 2.1 time: 0.381616 Jun 21 18:31:28.056679 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 123/239] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:27 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:28.138043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4c25e8fd-f879-4d82-a369-9ca564c153c1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:28.138768 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4c25e8fd-f879-4d82-a369-9ca564c153c1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:28.154103 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4c25e8fd-f879-4d82-a369-9ca564c153c1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:28.155021 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4c25e8fd-f879-4d82-a369-9ca564c153c1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:28.156590 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4c25e8fd-f879-4d82-a369-9ca564c153c1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:28.157367 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4c25e8fd-f879-4d82-a369-9ca564c153c1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:28.220765 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4c25e8fd-f879-4d82-a369-9ca564c153c1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Going to try to terminate instance {{(pid=118108) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:31:28.383892 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=8 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:28.475987 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4c25e8fd-f879-4d82-a369-9ca564c153c1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "DELETE /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 204 len: 0 microversion: 2.1 time: 0.343676 Jun 21 18:31:28.477549 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 117/240] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:31:28 2022] DELETE /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:31:28.491310 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8991eb04-9479-455f-ac70-29581055d840 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:28.492402 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8991eb04-9479-455f-ac70-29581055d840 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:28.504144 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8991eb04-9479-455f-ac70-29581055d840 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:28.505238 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8991eb04-9479-455f-ac70-29581055d840 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:28.506707 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8991eb04-9479-455f-ac70-29581055d840 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:28.507929 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8991eb04-9479-455f-ac70-29581055d840 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:28.539260 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:28.776092 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-7990efa4-e168-4a35-805d-03b234c60e9c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:28.778055 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-7990efa4-e168-4a35-805d-03b234c60e9c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:28.790273 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7990efa4-e168-4a35-805d-03b234c60e9c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:28.791042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7990efa4-e168-4a35-805d-03b234c60e9c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:28.792752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7990efa4-e168-4a35-805d-03b234c60e9c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:28.794241 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7990efa4-e168-4a35-805d-03b234c60e9c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:28.813385 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-8991eb04-9479-455f-ac70-29581055d840 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:28.830150 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8991eb04-9479-455f-ac70-29581055d840 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1504 microversion: 2.1 time: 0.344992 Jun 21 18:31:28.831030 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 124/241] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:28 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1504 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:29.087313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e0f490f6-13ac-45fa-ac5a-2e8cf8fc8fec tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:29.088865 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e0f490f6-13ac-45fa-ac5a-2e8cf8fc8fec tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:29.103078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e0f490f6-13ac-45fa-ac5a-2e8cf8fc8fec tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:29.103842 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e0f490f6-13ac-45fa-ac5a-2e8cf8fc8fec tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:29.105259 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e0f490f6-13ac-45fa-ac5a-2e8cf8fc8fec tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:29.106462 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e0f490f6-13ac-45fa-ac5a-2e8cf8fc8fec tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:29.106648 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-7990efa4-e168-4a35-805d-03b234c60e9c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:29.143326 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-7990efa4-e168-4a35-805d-03b234c60e9c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1318 microversion: 2.1 time: 0.373604 Jun 21 18:31:29.147811 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 118/242] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:28 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:29.336821 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e0f490f6-13ac-45fa-ac5a-2e8cf8fc8fec tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:29.357393 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e0f490f6-13ac-45fa-ac5a-2e8cf8fc8fec tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1522 microversion: 2.1 time: 0.275917 Jun 21 18:31:29.370421 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 125/243] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:29 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:29.865078 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-290dd9ea-5b9c-4688-80d9-a59efe14aeac tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:29.865078 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-290dd9ea-5b9c-4688-80d9-a59efe14aeac tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:29.875728 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-290dd9ea-5b9c-4688-80d9-a59efe14aeac tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:29.876601 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-290dd9ea-5b9c-4688-80d9-a59efe14aeac tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:29.878512 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-290dd9ea-5b9c-4688-80d9-a59efe14aeac tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:29.879315 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-290dd9ea-5b9c-4688-80d9-a59efe14aeac tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:30.096022 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-290dd9ea-5b9c-4688-80d9-a59efe14aeac tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:30.105608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-290dd9ea-5b9c-4688-80d9-a59efe14aeac tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1504 microversion: 2.1 time: 0.252174 Jun 21 18:31:30.106628 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 119/244] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:29 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:30.174731 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-052bf6f5-5d0e-46e3-aca0-384b9d89ad79 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:30.175655 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-052bf6f5-5d0e-46e3-aca0-384b9d89ad79 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:30.183093 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-052bf6f5-5d0e-46e3-aca0-384b9d89ad79 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:30.183728 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-052bf6f5-5d0e-46e3-aca0-384b9d89ad79 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:30.184863 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-052bf6f5-5d0e-46e3-aca0-384b9d89ad79 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:30.185570 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-052bf6f5-5d0e-46e3-aca0-384b9d89ad79 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:30.350442 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-052bf6f5-5d0e-46e3-aca0-384b9d89ad79 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:30.363777 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-052bf6f5-5d0e-46e3-aca0-384b9d89ad79 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1318 microversion: 2.1 time: 0.193337 Jun 21 18:31:30.364713 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 126/245] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:30 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:30.389679 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-41f519ca-0695-463e-b47e-3c9c62c0a7d4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:30.390692 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-41f519ca-0695-463e-b47e-3c9c62c0a7d4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:30.413673 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-41f519ca-0695-463e-b47e-3c9c62c0a7d4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:30.413673 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-41f519ca-0695-463e-b47e-3c9c62c0a7d4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:30.413673 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-41f519ca-0695-463e-b47e-3c9c62c0a7d4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:30.413673 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-41f519ca-0695-463e-b47e-3c9c62c0a7d4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:31.009612 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-41f519ca-0695-463e-b47e-3c9c62c0a7d4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:31.019524 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-41f519ca-0695-463e-b47e-3c9c62c0a7d4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1522 microversion: 2.1 time: 0.637223 Jun 21 18:31:31.020129 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 120/246] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:30 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1522 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:31.132970 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-9e23ffbe-1da6-4433-a75e-3334645278d5 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:31.134566 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-9e23ffbe-1da6-4433-a75e-3334645278d5 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:31.146002 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9e23ffbe-1da6-4433-a75e-3334645278d5 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:31.146760 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9e23ffbe-1da6-4433-a75e-3334645278d5 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:31.148781 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9e23ffbe-1da6-4433-a75e-3334645278d5 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:31.150306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9e23ffbe-1da6-4433-a75e-3334645278d5 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:31.386799 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-7d292440-ad48-4ab9-af5f-d57e8316af60 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:31.388437 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-7d292440-ad48-4ab9-af5f-d57e8316af60 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:31.401311 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7d292440-ad48-4ab9-af5f-d57e8316af60 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:31.403720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7d292440-ad48-4ab9-af5f-d57e8316af60 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:31.405148 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7d292440-ad48-4ab9-af5f-d57e8316af60 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:31.406303 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7d292440-ad48-4ab9-af5f-d57e8316af60 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:31.409335 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-9e23ffbe-1da6-4433-a75e-3334645278d5 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:31.424055 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-9e23ffbe-1da6-4433-a75e-3334645278d5 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1504 microversion: 2.1 time: 0.295522 Jun 21 18:31:31.425124 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 127/247] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:31 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1504 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:31.630371 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-7d292440-ad48-4ab9-af5f-d57e8316af60 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:31.646450 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-7d292440-ad48-4ab9-af5f-d57e8316af60 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1318 microversion: 2.1 time: 0.265969 Jun 21 18:31:31.647480 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 121/248] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:31 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:32.039918 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-d887f718-970a-4e3d-9933-95fb2f2d5952 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:32.041511 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-d887f718-970a-4e3d-9933-95fb2f2d5952 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:32.052849 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d887f718-970a-4e3d-9933-95fb2f2d5952 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:32.053593 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d887f718-970a-4e3d-9933-95fb2f2d5952 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:32.055948 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d887f718-970a-4e3d-9933-95fb2f2d5952 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:32.056910 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d887f718-970a-4e3d-9933-95fb2f2d5952 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:32.326718 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-d887f718-970a-4e3d-9933-95fb2f2d5952 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:32.337782 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-d887f718-970a-4e3d-9933-95fb2f2d5952 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1522 microversion: 2.1 time: 0.303990 Jun 21 18:31:32.338383 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 128/249] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:32 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:32.446192 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-cafadf07-1a69-48a9-bc53-ff6a7e9e6828 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:32.447013 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-cafadf07-1a69-48a9-bc53-ff6a7e9e6828 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:32.455787 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cafadf07-1a69-48a9-bc53-ff6a7e9e6828 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:32.455787 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cafadf07-1a69-48a9-bc53-ff6a7e9e6828 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:32.457253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cafadf07-1a69-48a9-bc53-ff6a7e9e6828 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:32.457898 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cafadf07-1a69-48a9-bc53-ff6a7e9e6828 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:32.670479 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a7e319cb-0814-43e4-9bf3-fec934450969 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:32.671293 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-a7e319cb-0814-43e4-9bf3-fec934450969 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:32.678862 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a7e319cb-0814-43e4-9bf3-fec934450969 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:32.679855 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a7e319cb-0814-43e4-9bf3-fec934450969 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:32.680893 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a7e319cb-0814-43e4-9bf3-fec934450969 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:32.681784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a7e319cb-0814-43e4-9bf3-fec934450969 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:32.687209 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-cafadf07-1a69-48a9-bc53-ff6a7e9e6828 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:32.703036 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-cafadf07-1a69-48a9-bc53-ff6a7e9e6828 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1504 microversion: 2.1 time: 0.263917 Jun 21 18:31:32.704322 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 122/250] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:32 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:32.927452 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-a7e319cb-0814-43e4-9bf3-fec934450969 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:32.936865 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-a7e319cb-0814-43e4-9bf3-fec934450969 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1318 microversion: 2.1 time: 0.273872 Jun 21 18:31:32.938183 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 129/251] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:32 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:33.366040 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-ec161abe-4294-43ad-80c7-2e5ff4f934c9 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:33.373307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-ec161abe-4294-43ad-80c7-2e5ff4f934c9 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:33.390735 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ec161abe-4294-43ad-80c7-2e5ff4f934c9 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:33.392176 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ec161abe-4294-43ad-80c7-2e5ff4f934c9 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:33.394178 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ec161abe-4294-43ad-80c7-2e5ff4f934c9 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:33.395293 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ec161abe-4294-43ad-80c7-2e5ff4f934c9 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:33.731313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e4276dbe-4c2f-432b-b199-4db79cf70d5c tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:33.732360 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e4276dbe-4c2f-432b-b199-4db79cf70d5c tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:33.761147 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e4276dbe-4c2f-432b-b199-4db79cf70d5c tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:33.761748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e4276dbe-4c2f-432b-b199-4db79cf70d5c tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:33.762719 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e4276dbe-4c2f-432b-b199-4db79cf70d5c tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:33.763160 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e4276dbe-4c2f-432b-b199-4db79cf70d5c tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:34.203165 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ec161abe-4294-43ad-80c7-2e5ff4f934c9 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:34.218595 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-ec161abe-4294-43ad-80c7-2e5ff4f934c9 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1522 microversion: 2.1 time: 0.863612 Jun 21 18:31:34.219512 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 123/252] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:33 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1522 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:34.226886 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-dbf361d2-8e39-4580-acca-0bf8916a09e3 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:34.228679 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-dbf361d2-8e39-4580-acca-0bf8916a09e3 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:34.253320 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dbf361d2-8e39-4580-acca-0bf8916a09e3 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:34.259797 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dbf361d2-8e39-4580-acca-0bf8916a09e3 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:34.262312 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dbf361d2-8e39-4580-acca-0bf8916a09e3 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:34.262312 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dbf361d2-8e39-4580-acca-0bf8916a09e3 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:34.286475 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e4276dbe-4c2f-432b-b199-4db79cf70d5c tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:34.354445 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e4276dbe-4c2f-432b-b199-4db79cf70d5c tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1504 microversion: 2.1 time: 0.625045 Jun 21 18:31:34.363462 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 130/253] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:33 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1504 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:34.704613 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-dbf361d2-8e39-4580-acca-0bf8916a09e3 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:34.730320 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-dbf361d2-8e39-4580-acca-0bf8916a09e3 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1318 microversion: 2.1 time: 0.508447 Jun 21 18:31:34.754692 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 124/254] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:34 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1318 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:34.956553 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-303abe16-568e-4ff9-b215-2c15cc736f7d req-8a4cdf35-3507-4e3b-b821-a262289d8154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37994aca-0c56-441a-a9f4-740d241ef940", "name": "network-vif-deleted", "tag": "b41d930a-b63e-473c-9683-a53a13d4c88f"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:34.996410 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-303abe16-568e-4ff9-b215-2c15cc736f7d req-8a4cdf35-3507-4e3b-b821-a262289d8154 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:34.997220 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-303abe16-568e-4ff9-b215-2c15cc736f7d req-8a4cdf35-3507-4e3b-b821-a262289d8154 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:35.042725 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-303abe16-568e-4ff9-b215-2c15cc736f7d req-8a4cdf35-3507-4e3b-b821-a262289d8154 service nova] Creating event network-vif-deleted:b41d930a-b63e-473c-9683-a53a13d4c88f for instance 37994aca-0c56-441a-a9f4-740d241ef940 on hv-cinder-84460 Jun 21 18:31:35.054046 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-303abe16-568e-4ff9-b215-2c15cc736f7d req-8a4cdf35-3507-4e3b-b821-a262289d8154 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104932 Jun 21 18:31:35.055443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 131/255] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:31:35.253380 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-094c63e0-75d6-4dc9-8363-90d55157e2e4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:35.255974 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-094c63e0-75d6-4dc9-8363-90d55157e2e4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:35.269001 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-094c63e0-75d6-4dc9-8363-90d55157e2e4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:35.269827 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-094c63e0-75d6-4dc9-8363-90d55157e2e4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:35.271467 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-094c63e0-75d6-4dc9-8363-90d55157e2e4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:35.272060 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-094c63e0-75d6-4dc9-8363-90d55157e2e4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:35.391655 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-70b78d38-97e3-42d8-9fbf-da00fcb76509 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:35.393107 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-70b78d38-97e3-42d8-9fbf-da00fcb76509 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:35.406289 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-70b78d38-97e3-42d8-9fbf-da00fcb76509 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:35.407174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-70b78d38-97e3-42d8-9fbf-da00fcb76509 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:35.408376 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-70b78d38-97e3-42d8-9fbf-da00fcb76509 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:35.409041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-70b78d38-97e3-42d8-9fbf-da00fcb76509 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:35.670474 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-70b78d38-97e3-42d8-9fbf-da00fcb76509 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:35.692339 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-70b78d38-97e3-42d8-9fbf-da00fcb76509 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 200 len: 1299 microversion: 2.1 time: 0.307123 Jun 21 18:31:35.707236 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 132/256] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:35 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 1299 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:35.763204 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-094c63e0-75d6-4dc9-8363-90d55157e2e4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:35.764060 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2e0e9514-747a-4df6-8b61-dbaea846e7dd tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:35.765226 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-2e0e9514-747a-4df6-8b61-dbaea846e7dd tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:35.780319 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2e0e9514-747a-4df6-8b61-dbaea846e7dd tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:35.780982 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2e0e9514-747a-4df6-8b61-dbaea846e7dd tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:35.781947 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2e0e9514-747a-4df6-8b61-dbaea846e7dd tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:35.783076 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2e0e9514-747a-4df6-8b61-dbaea846e7dd tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:35.792193 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-094c63e0-75d6-4dc9-8363-90d55157e2e4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1522 microversion: 2.1 time: 0.543700 Jun 21 18:31:35.792193 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 125/257] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:35 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1522 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:36.031653 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2e0e9514-747a-4df6-8b61-dbaea846e7dd tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:36.057293 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-2e0e9514-747a-4df6-8b61-dbaea846e7dd tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1318 microversion: 2.1 time: 0.297768 Jun 21 18:31:36.058317 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 133/258] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:35 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:36.309525 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-bda17dd2-e566-4cbf-83a8-19d89ddc41bb req-c76f1f23-d199-4ef5-a686-fc3bdd3c317a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38292b40-45ba-4fe8-afa4-b0d3844b87c3", "name": "network-vif-plugged", "status": "completed", "tag": "0945feb3-aa60-4570-a771-8886a7667bfc"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:36.320951 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-bda17dd2-e566-4cbf-83a8-19d89ddc41bb req-c76f1f23-d199-4ef5-a686-fc3bdd3c317a service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:36.321401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-bda17dd2-e566-4cbf-83a8-19d89ddc41bb req-c76f1f23-d199-4ef5-a686-fc3bdd3c317a service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:36.338654 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-bda17dd2-e566-4cbf-83a8-19d89ddc41bb req-c76f1f23-d199-4ef5-a686-fc3bdd3c317a service nova] Creating event network-vif-plugged:0945feb3-aa60-4570-a771-8886a7667bfc for instance 38292b40-45ba-4fe8-afa4-b0d3844b87c3 on hv-cinder-84460 Jun 21 18:31:36.347031 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-bda17dd2-e566-4cbf-83a8-19d89ddc41bb req-c76f1f23-d199-4ef5-a686-fc3bdd3c317a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044456 Jun 21 18:31:36.348135 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 126/259] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:31:36.717915 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-933dbead-fc19-4196-b7c7-a2898f430f42 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:36.718955 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-933dbead-fc19-4196-b7c7-a2898f430f42 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 37994aca-0c56-441a-a9f4-740d241ef940] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:36.729344 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-933dbead-fc19-4196-b7c7-a2898f430f42 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:36.730337 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-933dbead-fc19-4196-b7c7-a2898f430f42 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:36.731536 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-933dbead-fc19-4196-b7c7-a2898f430f42 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:36.732102 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-933dbead-fc19-4196-b7c7-a2898f430f42 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:36.748640 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-933dbead-fc19-4196-b7c7-a2898f430f42 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] HTTP exception thrown: Instance 37994aca-0c56-441a-a9f4-740d241ef940 could not be found. Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-933dbead-fc19-4196-b7c7-a2898f430f42 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Request method failure captured: Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 HTTP/1.1 Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg5b85-0Pk-59iMvKhG4wDc804N2hlGI1NYnsBz1tE4aqqkGOZjYjJbisfLw0g92aEQ4iDyrYw_T_8U351WxKzlYC7DlIiSZsgnen7emWHZPgf7q2DRP_Z8Iv81D9kNucl8an__KBWU_O2rKRDgLwLqJ8UmeAeCsf0kkTwIe6JA75QA Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 0307481a33be4b268d2793bb65f9d9ef Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-VolumesActionsTest-1158214866 Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:31:36.750827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:31:36.753099 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0307481a33be4b268d2793bb65f9d9ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/0307481a33be4b268d2793bb65f9d9ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0307481a33be4b268d2793bb65f9d9ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_0307481a33be4b268d2793bb65f9d9ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:31:36.753099 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-VolumesActionsTest-1158214866 Jun 21 18:31:36.753099 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 0307481a33be4b268d2793bb65f9d9ef Jun 21 18:31:36.753099 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-VolumesActionsTest-1158214866 Jun 21 18:31:36.753099 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-VolumesActionsTest-1158214866-project Jun 21 18:31:36.753099 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:31:36.753099 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:31:36.753099 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: 82c323bc7a8c45e39714bb3e7f401c3a Jun 21 18:31:36.753099 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-VolumesActionsTest-1158214866-project Jun 21 18:31:36.753099 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:31:36.753099 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance 37994aca-0c56-441a-a9f4-740d241ef940 could not be found. Jun 21 18:31:36.753099 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': '37994aca-0c56-441a-a9f4-740d241ef940'} Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37994aca-0c56-441a-a9f4-740d241ef940 could not be found. Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:31:36.753897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:31:36.755041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:31:36.755041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:31:36.755041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:31:36.755041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:31:36.755041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:31:36.755041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:31:36.755041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:31:36.755041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37994aca-0c56-441a-a9f4-740d241ef940 could not be found. Jun 21 18:31:36.755041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:36.755041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:36.755041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:36.755041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:36.755041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:36.755041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:36.755041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:31:36.755041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:31:36.755041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37994aca-0c56-441a-a9f4-740d241ef940 could not be found. Jun 21 18:31:36.755041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:36.756133 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-933dbead-fc19-4196-b7c7-a2898f430f42 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Returning 404 to user: Instance 37994aca-0c56-441a-a9f4-740d241ef940 could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:31:36.756133 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-933dbead-fc19-4196-b7c7-a2898f430f42 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940" status: 404 len: 111 microversion: 2.1 time: 0.041205 Jun 21 18:31:36.756133 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 134/260] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:36 2022] GET /compute/v2.1/servers/37994aca-0c56-441a-a9f4-740d241ef940 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:31:36.827165 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6c493662-1954-4598-87c9-8b4b42039cef tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:36.829260 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-6c493662-1954-4598-87c9-8b4b42039cef tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:36.840399 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6c493662-1954-4598-87c9-8b4b42039cef tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:36.840399 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6c493662-1954-4598-87c9-8b4b42039cef tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:36.841666 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6c493662-1954-4598-87c9-8b4b42039cef tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:36.842717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6c493662-1954-4598-87c9-8b4b42039cef tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:36.923986 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6c2890be-4a4f-4caa-ae61-311215ac7267 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-655143924", "imageRef": "c28659fb-c2d3-4dda-a330-1323a974987e", "flavorRef": "452", "networks": [{"uuid": "822fd099-0b53-4ae6-922b-7d0357c71362"}]}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:37.048146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.network.neutron [None req-6c2890be-4a4f-4caa-ae61-311215ac7267 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] validate_networks() for [('822fd099-0b53-4ae6-922b-7d0357c71362', None, None, None, None, None)] {{(pid=118109) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:31:37.239993 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6c493662-1954-4598-87c9-8b4b42039cef tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:37.249516 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6c493662-1954-4598-87c9-8b4b42039cef tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1522 microversion: 2.1 time: 0.429880 Jun 21 18:31:37.250232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 127/261] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:36 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:37.255363 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2e0fcc82-f27e-4a54-9795-fd357f835b0f tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:37.255972 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-2e0fcc82-f27e-4a54-9795-fd357f835b0f tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:37.265024 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e0fcc82-f27e-4a54-9795-fd357f835b0f tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:37.265799 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e0fcc82-f27e-4a54-9795-fd357f835b0f tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:37.266895 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e0fcc82-f27e-4a54-9795-fd357f835b0f tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:37.267610 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e0fcc82-f27e-4a54-9795-fd357f835b0f tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:37.552603 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2e0fcc82-f27e-4a54-9795-fd357f835b0f tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:37.567602 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2e0fcc82-f27e-4a54-9795-fd357f835b0f tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1318 microversion: 2.1 time: 0.315632 Jun 21 18:31:37.568668 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 128/262] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:37 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:37.922163 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-6c2890be-4a4f-4caa-ae61-311215ac7267 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Flavor limits 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:31:37.923364 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-6c2890be-4a4f-4caa-ae61-311215ac7267 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Image limits 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:31:37.924241 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-6c2890be-4a4f-4caa-ae61-311215ac7267 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Flavor pref 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:31:37.925061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-6c2890be-4a4f-4caa-ae61-311215ac7267 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Image pref 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:31:37.925879 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-6c2890be-4a4f-4caa-ae61-311215ac7267 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:31:37.959714 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6c2890be-4a4f-4caa-ae61-311215ac7267 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:37.960653 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6c2890be-4a4f-4caa-ae61-311215ac7267 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:37.966169 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6c2890be-4a4f-4caa-ae61-311215ac7267 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:37.967296 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6c2890be-4a4f-4caa-ae61-311215ac7267 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:38.010179 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-6c2890be-4a4f-4caa-ae61-311215ac7267 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Getting quotas for project 0307481a33be4b268d2793bb65f9d9ef. Resources: {'instances', 'ram', 'cores'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:31:38.022327 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-6c2890be-4a4f-4caa-ae61-311215ac7267 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Getting quotas for user 82c323bc7a8c45e39714bb3e7f401c3a and project 0307481a33be4b268d2793bb65f9d9ef. Resources: {'instances', 'ram', 'cores'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:31:38.052381 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6c2890be-4a4f-4caa-ae61-311215ac7267 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Going to run 1 instances... {{(pid=118109) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:31:38.065355 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6c2890be-4a4f-4caa-ae61-311215ac7267 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c28659fb-c2d3-4dda-a330-1323a974987e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118109) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:31:38.197966 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6c2890be-4a4f-4caa-ae61-311215ac7267 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.278466 Jun 21 18:31:38.207254 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 135/263] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:31:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:31:38.221514 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-771bbc0c-ae5b-4a5e-94a1-a4633dd2447a tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:38.222697 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-771bbc0c-ae5b-4a5e-94a1-a4633dd2447a tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:38.283959 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-560c7734-908d-4915-8718-983495581251 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:38.288127 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-560c7734-908d-4915-8718-983495581251 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:38.323830 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-560c7734-908d-4915-8718-983495581251 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:38.328484 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-560c7734-908d-4915-8718-983495581251 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:38.331897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-560c7734-908d-4915-8718-983495581251 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:38.336631 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-560c7734-908d-4915-8718-983495581251 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:38.461434 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-771bbc0c-ae5b-4a5e-94a1-a4633dd2447a tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:38.491598 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-771bbc0c-ae5b-4a5e-94a1-a4633dd2447a tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1213 microversion: 2.1 time: 0.274944 Jun 21 18:31:38.514876 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 129/264] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:38 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1213 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:38.596516 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-1d8b8ed7-1bc3-4dfc-8fdc-6c0bbbba4c2c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:38.597701 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-1d8b8ed7-1bc3-4dfc-8fdc-6c0bbbba4c2c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:38.623015 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1d8b8ed7-1bc3-4dfc-8fdc-6c0bbbba4c2c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:38.623722 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1d8b8ed7-1bc3-4dfc-8fdc-6c0bbbba4c2c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:38.624680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1d8b8ed7-1bc3-4dfc-8fdc-6c0bbbba4c2c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:38.625496 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1d8b8ed7-1bc3-4dfc-8fdc-6c0bbbba4c2c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:38.726621 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-560c7734-908d-4915-8718-983495581251 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:38.761559 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-560c7734-908d-4915-8718-983495581251 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1502 microversion: 2.1 time: 0.486650 Jun 21 18:31:38.767401 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 136/265] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:38 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1502 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:38.789762 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6a6d8155-ca21-4414-a5ba-a9740bbfdcfe tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d96f3149-9a12-448a-a1c4-c8541545d964"}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:38.791463 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6a6d8155-ca21-4414-a5ba-a9740bbfdcfe tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:38.822343 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6a6d8155-ca21-4414-a5ba-a9740bbfdcfe tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:38.823331 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6a6d8155-ca21-4414-a5ba-a9740bbfdcfe tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:38.824789 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6a6d8155-ca21-4414-a5ba-a9740bbfdcfe tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:38.825426 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6a6d8155-ca21-4414-a5ba-a9740bbfdcfe tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:38.892785 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-6a6d8155-ca21-4414-a5ba-a9740bbfdcfe tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] HTTP exception thrown: Cannot 'attach_volume' instance c3e33553-dc4c-4e34-8533-beea14017592 while it is in vm_state rescued Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6a6d8155-ca21-4414-a5ba-a9740bbfdcfe tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Request method failure captured: Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: POST /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592/os-volume_attachments HTTP/1.1 Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 74 Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg3_Pnx5ZJZEy_IdO1FVKKz0eLIc_62ltL3NJ6cmKflv6yZyt7QxyJvFplTihWds8VBITWE0yiTGANcSfrrGMK4zcFgLYB379BkRv2UsJO-YDM9lyF0_DS77njTRdJg7kVpdIgc_ghlZeUGuKsri6aMYf7i959Igr4Q6i6zwhEftaP4 Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 6538654ef94d4036a7a8d5614b80b0ed Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-813750082 Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:31:38.905489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:31:38.908976 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:31:38.908976 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-ServerRescueNegativeTestJSON-813750082 Jun 21 18:31:38.908976 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 6538654ef94d4036a7a8d5614b80b0ed Jun 21 18:31:38.908976 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-813750082 Jun 21 18:31:38.908976 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-ServerRescueNegativeTestJSON-813750082-project Jun 21 18:31:38.908976 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:31:38.908976 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:31:38.908976 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: de09b91800314d06aeddafe3c12a77b3 Jun 21 18:31:38.908976 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-ServerRescueNegativeTestJSON-813750082-project Jun 21 18:31:38.908976 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Jun 21 18:31:38.908976 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {"volumeAttachment": {"volumeId": "d96f3149-9a12-448a-a1c4-c8541545d964"}} Jun 21 18:31:38.908976 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:31:38.910691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Cannot 'attach_volume' instance c3e33553-dc4c-4e34-8533-beea14017592 while it is in vm_state rescued Jun 21 18:31:38.910691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'server_id': 'c3e33553-dc4c-4e34-8533-beea14017592', 'body': {'volumeAttachment': {'volumeId': 'd96f3149-9a12-448a-a1c4-c8541545d964'}}} Jun 21 18:31:38.910691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:31:38.910691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:38.910691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 18:31:38.910691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 18:31:38.910691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 18:31:38.910691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 18:31:38.910691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 18:31:38.910691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 18:31:38.910691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c3e33553-dc4c-4e34-8533-beea14017592 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 21 18:31:38.910691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:38.910691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:38.910691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:38.910691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:38.910691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:38.910691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:38.910691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:31:38.910691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:31:38.913068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:31:38.913068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:31:38.913068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 18:31:38.913068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:31:38.913068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 18:31:38.913068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:31:38.913068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 18:31:38.913068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:31:38.913068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 21 18:31:38.913068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 18:31:38.913068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 18:31:38.913068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 18:31:38.913068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c3e33553-dc4c-4e34-8533-beea14017592 while it is in vm_state rescued Jun 21 18:31:38.913068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:38.913068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:31:38.913068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:38.913068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:31:38.913068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:31:38.913068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:31:38.915389 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:31:38.915389 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:31:38.915389 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c3e33553-dc4c-4e34-8533-beea14017592 while it is in vm_state rescued Jun 21 18:31:38.915389 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:31:38.915389 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6a6d8155-ca21-4414-a5ba-a9740bbfdcfe tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Returning 409 to user: Cannot 'attach_volume' instance c3e33553-dc4c-4e34-8533-beea14017592 while it is in vm_state rescued {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:31:38.917449 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6a6d8155-ca21-4414-a5ba-a9740bbfdcfe tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "POST /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.130096 Jun 21 18:31:38.917669 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 137/266] 10.222.0.87 () {60 vars in 1322 bytes} [Tue Jun 21 18:31:38 2022] POST /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592/os-volume_attachments => generated 152 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 21 18:31:38.937401 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-66f6c134-f9b0-47eb-a61d-be66a5857091 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:38.942527 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-66f6c134-f9b0-47eb-a61d-be66a5857091 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:38.971967 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-66f6c134-f9b0-47eb-a61d-be66a5857091 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:38.973598 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-66f6c134-f9b0-47eb-a61d-be66a5857091 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:38.974693 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-66f6c134-f9b0-47eb-a61d-be66a5857091 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:38.976315 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-66f6c134-f9b0-47eb-a61d-be66a5857091 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:38.983729 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-1d8b8ed7-1bc3-4dfc-8fdc-6c0bbbba4c2c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:38.989583 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:39.007035 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-1d8b8ed7-1bc3-4dfc-8fdc-6c0bbbba4c2c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1318 microversion: 2.1 time: 0.417073 Jun 21 18:31:39.018553 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 130/267] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:38 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:39.178334 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-66f6c134-f9b0-47eb-a61d-be66a5857091 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "POST /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592/action" status: 202 len: 0 microversion: 2.1 time: 0.252652 Jun 21 18:31:39.180504 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 138/268] 10.222.0.87 () {60 vars in 1277 bytes} [Tue Jun 21 18:31:38 2022] POST /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:31:39.207235 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-220bff1e-8400-4efd-b7b9-56ae12eaaa98 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:39.208854 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-220bff1e-8400-4efd-b7b9-56ae12eaaa98 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:39.223962 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-220bff1e-8400-4efd-b7b9-56ae12eaaa98 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:39.225804 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-220bff1e-8400-4efd-b7b9-56ae12eaaa98 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:39.230059 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-220bff1e-8400-4efd-b7b9-56ae12eaaa98 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:39.233039 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-220bff1e-8400-4efd-b7b9-56ae12eaaa98 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:39.532799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-14cb8eb5-7dbf-48cb-9e28-6a9224ac6860 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:39.534164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-14cb8eb5-7dbf-48cb-9e28-6a9224ac6860 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:39.553325 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-14cb8eb5-7dbf-48cb-9e28-6a9224ac6860 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:39.558552 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-14cb8eb5-7dbf-48cb-9e28-6a9224ac6860 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:39.560190 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-14cb8eb5-7dbf-48cb-9e28-6a9224ac6860 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:39.560965 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-14cb8eb5-7dbf-48cb-9e28-6a9224ac6860 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:39.601824 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-220bff1e-8400-4efd-b7b9-56ae12eaaa98 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:39.619397 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-220bff1e-8400-4efd-b7b9-56ae12eaaa98 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1510 microversion: 2.1 time: 0.425992 Jun 21 18:31:39.619992 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 131/269] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:39 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1510 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:39.738860 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-14cb8eb5-7dbf-48cb-9e28-6a9224ac6860 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:39.753311 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-14cb8eb5-7dbf-48cb-9e28-6a9224ac6860 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1209 microversion: 2.1 time: 0.227675 Jun 21 18:31:39.754344 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 139/270] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:39 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1209 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:40.050432 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-48edcbef-a14b-467e-a45f-34b96b97e311 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:40.051604 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-48edcbef-a14b-467e-a45f-34b96b97e311 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:40.102469 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-48edcbef-a14b-467e-a45f-34b96b97e311 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:40.103311 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-48edcbef-a14b-467e-a45f-34b96b97e311 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:40.113397 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-48edcbef-a14b-467e-a45f-34b96b97e311 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:40.115626 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-48edcbef-a14b-467e-a45f-34b96b97e311 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:40.646259 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-119db81d-858f-4789-9fb5-f775892be031 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:40.651489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-119db81d-858f-4789-9fb5-f775892be031 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:40.656805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-48edcbef-a14b-467e-a45f-34b96b97e311 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:40.680315 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-119db81d-858f-4789-9fb5-f775892be031 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:40.681027 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-119db81d-858f-4789-9fb5-f775892be031 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:40.682370 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-119db81d-858f-4789-9fb5-f775892be031 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:40.683069 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-119db81d-858f-4789-9fb5-f775892be031 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:40.690728 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-48edcbef-a14b-467e-a45f-34b96b97e311 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1318 microversion: 2.1 time: 0.656003 Jun 21 18:31:40.692217 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 132/271] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:40 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1318 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:40.785994 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c00c130e-14ef-41fd-9ce0-f7f288c00910 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:40.787996 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c00c130e-14ef-41fd-9ce0-f7f288c00910 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:40.806292 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c00c130e-14ef-41fd-9ce0-f7f288c00910 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:40.807753 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c00c130e-14ef-41fd-9ce0-f7f288c00910 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:40.810481 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c00c130e-14ef-41fd-9ce0-f7f288c00910 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:40.812132 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c00c130e-14ef-41fd-9ce0-f7f288c00910 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:40.968387 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c00c130e-14ef-41fd-9ce0-f7f288c00910 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:40.988359 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c00c130e-14ef-41fd-9ce0-f7f288c00910 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1283 microversion: 2.1 time: 0.213085 Jun 21 18:31:40.994700 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 133/272] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:40 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1283 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:41.143338 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-119db81d-858f-4789-9fb5-f775892be031 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:41.159245 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-119db81d-858f-4789-9fb5-f775892be031 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1510 microversion: 2.1 time: 0.518758 Jun 21 18:31:41.160660 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 140/273] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:40 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1510 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:41.725869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-0fbbb4a2-e699-42fc-9129-61799ed3b28b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:41.726915 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-0fbbb4a2-e699-42fc-9129-61799ed3b28b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:41.740007 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0fbbb4a2-e699-42fc-9129-61799ed3b28b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:41.740784 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0fbbb4a2-e699-42fc-9129-61799ed3b28b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:41.742130 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0fbbb4a2-e699-42fc-9129-61799ed3b28b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:41.742817 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0fbbb4a2-e699-42fc-9129-61799ed3b28b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:42.020698 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-defe5466-c4f6-4bc7-b16e-9f96df6006a6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:42.027231 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-defe5466-c4f6-4bc7-b16e-9f96df6006a6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:42.041869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-0fbbb4a2-e699-42fc-9129-61799ed3b28b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:42.047940 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-defe5466-c4f6-4bc7-b16e-9f96df6006a6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:42.049111 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-defe5466-c4f6-4bc7-b16e-9f96df6006a6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:42.050700 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-defe5466-c4f6-4bc7-b16e-9f96df6006a6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:42.051810 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-defe5466-c4f6-4bc7-b16e-9f96df6006a6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:42.068438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-0fbbb4a2-e699-42fc-9129-61799ed3b28b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1507 microversion: 2.1 time: 0.355048 Jun 21 18:31:42.070637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 134/274] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:41 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1507 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:42.214889 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f202a283-d0f5-4420-9d34-2473f48c4994 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:42.219314 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f202a283-d0f5-4420-9d34-2473f48c4994 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:42.242072 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f202a283-d0f5-4420-9d34-2473f48c4994 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:42.247870 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f202a283-d0f5-4420-9d34-2473f48c4994 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:42.255877 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f202a283-d0f5-4420-9d34-2473f48c4994 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:42.260455 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f202a283-d0f5-4420-9d34-2473f48c4994 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:42.519335 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-defe5466-c4f6-4bc7-b16e-9f96df6006a6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:42.545477 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-defe5466-c4f6-4bc7-b16e-9f96df6006a6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.533327 Jun 21 18:31:42.548569 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 141/275] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:42 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:42.651245 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f202a283-d0f5-4420-9d34-2473f48c4994 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:42.680325 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f202a283-d0f5-4420-9d34-2473f48c4994 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1510 microversion: 2.1 time: 0.490949 Jun 21 18:31:42.680934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 135/276] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:42 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1510 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:43.582845 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-14652ea2-9598-4067-b620-165b014e5bad tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:43.584724 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-14652ea2-9598-4067-b620-165b014e5bad tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:43.595512 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-14652ea2-9598-4067-b620-165b014e5bad tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:43.596288 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-14652ea2-9598-4067-b620-165b014e5bad tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:43.597618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-14652ea2-9598-4067-b620-165b014e5bad tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:43.598446 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-14652ea2-9598-4067-b620-165b014e5bad tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:43.632288 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:43.708715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-7fdd0bce-61e6-416e-9338-be944d92e00b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:43.708715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-7fdd0bce-61e6-416e-9338-be944d92e00b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:43.729606 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7fdd0bce-61e6-416e-9338-be944d92e00b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:43.730969 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7fdd0bce-61e6-416e-9338-be944d92e00b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:43.733537 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7fdd0bce-61e6-416e-9338-be944d92e00b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:43.734864 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7fdd0bce-61e6-416e-9338-be944d92e00b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:43.946600 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-14652ea2-9598-4067-b620-165b014e5bad tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:43.965997 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-14652ea2-9598-4067-b620-165b014e5bad tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.396297 Jun 21 18:31:43.983979 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 142/277] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:43 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:44.045861 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-7fdd0bce-61e6-416e-9338-be944d92e00b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:44.060152 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-7fdd0bce-61e6-416e-9338-be944d92e00b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1510 microversion: 2.1 time: 0.359789 Jun 21 18:31:44.061690 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 136/278] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:43 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1510 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:44.992947 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-3aeaebe9-0433-49f9-857c-74dbd8747abc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:44.994042 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-3aeaebe9-0433-49f9-857c-74dbd8747abc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:45.025966 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3aeaebe9-0433-49f9-857c-74dbd8747abc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:45.025966 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3aeaebe9-0433-49f9-857c-74dbd8747abc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:45.026435 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3aeaebe9-0433-49f9-857c-74dbd8747abc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:45.026974 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3aeaebe9-0433-49f9-857c-74dbd8747abc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:45.092320 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e8ab30ae-713a-42a3-9fdd-15557f6ee0fc tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:45.093568 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e8ab30ae-713a-42a3-9fdd-15557f6ee0fc tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:45.119323 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e8ab30ae-713a-42a3-9fdd-15557f6ee0fc tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:45.119841 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e8ab30ae-713a-42a3-9fdd-15557f6ee0fc tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:45.120723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e8ab30ae-713a-42a3-9fdd-15557f6ee0fc tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:45.121605 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e8ab30ae-713a-42a3-9fdd-15557f6ee0fc tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:45.877798 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-3aeaebe9-0433-49f9-857c-74dbd8747abc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:45.892301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e8ab30ae-713a-42a3-9fdd-15557f6ee0fc tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:45.909274 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-3aeaebe9-0433-49f9-857c-74dbd8747abc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.920895 Jun 21 18:31:45.932261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 143/279] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:44 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:45.932427 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e8ab30ae-713a-42a3-9fdd-15557f6ee0fc tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1510 microversion: 2.1 time: 0.845272 Jun 21 18:31:45.933331 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 137/280] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:45 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1510 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:46.943063 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bc0ac405-3ab3-4ce1-9bef-9caaba5f07fc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:46.944046 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-bc0ac405-3ab3-4ce1-9bef-9caaba5f07fc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:46.953772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bc0ac405-3ab3-4ce1-9bef-9caaba5f07fc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:46.954452 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bc0ac405-3ab3-4ce1-9bef-9caaba5f07fc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:46.955779 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bc0ac405-3ab3-4ce1-9bef-9caaba5f07fc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:46.956590 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bc0ac405-3ab3-4ce1-9bef-9caaba5f07fc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:46.962957 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c6d44c6d-0eb8-4749-ab31-70b2ee88a1da tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:46.964026 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c6d44c6d-0eb8-4749-ab31-70b2ee88a1da tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:46.976553 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c6d44c6d-0eb8-4749-ab31-70b2ee88a1da tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:46.977594 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c6d44c6d-0eb8-4749-ab31-70b2ee88a1da tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:46.979482 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c6d44c6d-0eb8-4749-ab31-70b2ee88a1da tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:46.980550 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c6d44c6d-0eb8-4749-ab31-70b2ee88a1da tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:47.407010 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-bc0ac405-3ab3-4ce1-9bef-9caaba5f07fc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:47.424312 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-bc0ac405-3ab3-4ce1-9bef-9caaba5f07fc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.487521 Jun 21 18:31:47.426105 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 144/281] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:46 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:47.427908 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c6d44c6d-0eb8-4749-ab31-70b2ee88a1da tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:47.446995 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c6d44c6d-0eb8-4749-ab31-70b2ee88a1da tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1510 microversion: 2.1 time: 0.491619 Jun 21 18:31:47.448753 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 138/282] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:46 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1510 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:48.460323 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f051b0bc-9c11-43f3-99ff-7fdf5bd716ad tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:48.464705 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f051b0bc-9c11-43f3-99ff-7fdf5bd716ad tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:48.492719 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-cb864149-4eb6-44bb-9e8e-df5eb3ad49c5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:48.496507 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-cb864149-4eb6-44bb-9e8e-df5eb3ad49c5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:48.520417 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=2 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:48.531577 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cb864149-4eb6-44bb-9e8e-df5eb3ad49c5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:48.532526 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cb864149-4eb6-44bb-9e8e-df5eb3ad49c5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:48.535016 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=2 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:48.535888 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cb864149-4eb6-44bb-9e8e-df5eb3ad49c5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:48.537574 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cb864149-4eb6-44bb-9e8e-df5eb3ad49c5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:48.544825 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=6 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:48.582019 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f051b0bc-9c11-43f3-99ff-7fdf5bd716ad tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:48.590666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f051b0bc-9c11-43f3-99ff-7fdf5bd716ad tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:48.595146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f051b0bc-9c11-43f3-99ff-7fdf5bd716ad tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:48.598399 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f051b0bc-9c11-43f3-99ff-7fdf5bd716ad tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:49.180495 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-cb864149-4eb6-44bb-9e8e-df5eb3ad49c5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:49.220282 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-cb864149-4eb6-44bb-9e8e-df5eb3ad49c5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1510 microversion: 2.1 time: 0.739803 Jun 21 18:31:49.227237 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 139/283] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:48 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1510 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:49.252704 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f051b0bc-9c11-43f3-99ff-7fdf5bd716ad tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:49.271681 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f051b0bc-9c11-43f3-99ff-7fdf5bd716ad tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.825149 Jun 21 18:31:49.272981 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 145/284] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:48 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:50.258223 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-fe883e4b-caf4-4074-a2c5-a1dc0513d211 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:50.258851 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-fe883e4b-caf4-4074-a2c5-a1dc0513d211 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:50.268380 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fe883e4b-caf4-4074-a2c5-a1dc0513d211 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:50.269069 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fe883e4b-caf4-4074-a2c5-a1dc0513d211 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:50.270388 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fe883e4b-caf4-4074-a2c5-a1dc0513d211 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:50.271200 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fe883e4b-caf4-4074-a2c5-a1dc0513d211 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:50.317403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e4e8be30-4834-45e6-9bc5-31c70345c274 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:50.320314 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e4e8be30-4834-45e6-9bc5-31c70345c274 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:50.333705 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e4e8be30-4834-45e6-9bc5-31c70345c274 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:50.348482 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e4e8be30-4834-45e6-9bc5-31c70345c274 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:50.350015 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e4e8be30-4834-45e6-9bc5-31c70345c274 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:50.358206 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e4e8be30-4834-45e6-9bc5-31c70345c274 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:50.707550 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-fe883e4b-caf4-4074-a2c5-a1dc0513d211 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:50.737557 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-fe883e4b-caf4-4074-a2c5-a1dc0513d211 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1516 microversion: 2.1 time: 0.483344 Jun 21 18:31:50.738930 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 140/285] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:50 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1516 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:31:50.745465 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-3898c33f-2454-4e7b-917f-7ed6ccc535de req-4fed336f-3350-41d8-aae6-2d9ec1b2c6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e78643f-ce2e-456f-80ed-10bb952f6095", "tag": "4922e0a8-97f2-4634-b22d-bd075ac21184"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:31:50.753539 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:50.768797 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-3898c33f-2454-4e7b-917f-7ed6ccc535de req-4fed336f-3350-41d8-aae6-2d9ec1b2c6a3 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:50.770133 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-3898c33f-2454-4e7b-917f-7ed6ccc535de req-4fed336f-3350-41d8-aae6-2d9ec1b2c6a3 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:50.800432 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-3898c33f-2454-4e7b-917f-7ed6ccc535de req-4fed336f-3350-41d8-aae6-2d9ec1b2c6a3 service nova] Creating event network-changed:4922e0a8-97f2-4634-b22d-bd075ac21184 for instance 8e78643f-ce2e-456f-80ed-10bb952f6095 on hv-cinder-84460 Jun 21 18:31:50.803735 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e4e8be30-4834-45e6-9bc5-31c70345c274 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:50.824059 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-3898c33f-2454-4e7b-917f-7ed6ccc535de req-4fed336f-3350-41d8-aae6-2d9ec1b2c6a3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075707 Jun 21 18:31:50.825795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 141/286] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:31:50.835692 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e4e8be30-4834-45e6-9bc5-31c70345c274 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.534445 Jun 21 18:31:50.837076 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 146/287] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:50 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:51.864787 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-494986eb-b18a-481c-8fde-be41e1f6b2d8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:51.864787 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-494986eb-b18a-481c-8fde-be41e1f6b2d8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:51.871393 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-494986eb-b18a-481c-8fde-be41e1f6b2d8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:51.871888 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-494986eb-b18a-481c-8fde-be41e1f6b2d8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:51.872735 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-494986eb-b18a-481c-8fde-be41e1f6b2d8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:51.873169 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-494986eb-b18a-481c-8fde-be41e1f6b2d8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:52.062077 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-494986eb-b18a-481c-8fde-be41e1f6b2d8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:52.075352 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-494986eb-b18a-481c-8fde-be41e1f6b2d8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.217371 Jun 21 18:31:52.076320 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 142/288] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:51 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:53.096337 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-3e1612ad-06b3-4e4b-bc8c-5720e7cf1d06 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:53.097002 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-3e1612ad-06b3-4e4b-bc8c-5720e7cf1d06 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:53.105827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3e1612ad-06b3-4e4b-bc8c-5720e7cf1d06 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:53.106626 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3e1612ad-06b3-4e4b-bc8c-5720e7cf1d06 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:53.107719 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3e1612ad-06b3-4e4b-bc8c-5720e7cf1d06 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:53.108441 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3e1612ad-06b3-4e4b-bc8c-5720e7cf1d06 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:53.272875 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-3e1612ad-06b3-4e4b-bc8c-5720e7cf1d06 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:53.282357 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-3e1612ad-06b3-4e4b-bc8c-5720e7cf1d06 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.190566 Jun 21 18:31:53.283023 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 147/289] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:53 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:54.300261 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-35f3f472-b510-4f81-ae8f-9095dc122c98 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:54.301047 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-35f3f472-b510-4f81-ae8f-9095dc122c98 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:54.307784 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-35f3f472-b510-4f81-ae8f-9095dc122c98 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:54.308230 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-35f3f472-b510-4f81-ae8f-9095dc122c98 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:54.308997 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-35f3f472-b510-4f81-ae8f-9095dc122c98 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:54.309441 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-35f3f472-b510-4f81-ae8f-9095dc122c98 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:54.490560 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-35f3f472-b510-4f81-ae8f-9095dc122c98 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:54.499264 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-35f3f472-b510-4f81-ae8f-9095dc122c98 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.202952 Jun 21 18:31:54.500268 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 143/290] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:54 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:55.522458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-7439439d-3ead-422b-9265-a536598524e8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:55.523528 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-7439439d-3ead-422b-9265-a536598524e8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:55.536748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7439439d-3ead-422b-9265-a536598524e8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:55.537551 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7439439d-3ead-422b-9265-a536598524e8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:55.538889 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7439439d-3ead-422b-9265-a536598524e8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:55.539648 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7439439d-3ead-422b-9265-a536598524e8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:55.783064 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-7439439d-3ead-422b-9265-a536598524e8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:55.792870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-7439439d-3ead-422b-9265-a536598524e8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.277616 Jun 21 18:31:55.793888 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 148/291] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:55 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:56.815039 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-fcf671e2-3836-4037-b6eb-957e0885c9c5 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:56.818157 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-fcf671e2-3836-4037-b6eb-957e0885c9c5 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:56.837911 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fcf671e2-3836-4037-b6eb-957e0885c9c5 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:56.838364 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fcf671e2-3836-4037-b6eb-957e0885c9c5 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:56.839532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fcf671e2-3836-4037-b6eb-957e0885c9c5 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:56.840323 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fcf671e2-3836-4037-b6eb-957e0885c9c5 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:57.091340 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-fcf671e2-3836-4037-b6eb-957e0885c9c5 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:57.100781 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-fcf671e2-3836-4037-b6eb-957e0885c9c5 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.293224 Jun 21 18:31:57.102301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 144/292] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:56 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:58.140586 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-89324f63-eadc-458d-b289-5d09fdf57da6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:58.141973 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-89324f63-eadc-458d-b289-5d09fdf57da6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:58.146401 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:31:58.158248 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-89324f63-eadc-458d-b289-5d09fdf57da6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:58.159035 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-89324f63-eadc-458d-b289-5d09fdf57da6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:58.160488 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-89324f63-eadc-458d-b289-5d09fdf57da6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:58.161264 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-89324f63-eadc-458d-b289-5d09fdf57da6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:58.406816 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-89324f63-eadc-458d-b289-5d09fdf57da6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:58.415751 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-89324f63-eadc-458d-b289-5d09fdf57da6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.282888 Jun 21 18:31:58.416325 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 149/293] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:58 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:31:59.435528 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-7041a2ea-66cf-45e8-8f47-74fdd9f25d14 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:31:59.436704 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-7041a2ea-66cf-45e8-8f47-74fdd9f25d14 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:31:59.445431 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7041a2ea-66cf-45e8-8f47-74fdd9f25d14 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:59.446054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7041a2ea-66cf-45e8-8f47-74fdd9f25d14 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:59.446974 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7041a2ea-66cf-45e8-8f47-74fdd9f25d14 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:31:59.447514 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7041a2ea-66cf-45e8-8f47-74fdd9f25d14 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:31:59.703539 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-7041a2ea-66cf-45e8-8f47-74fdd9f25d14 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:31:59.716901 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-7041a2ea-66cf-45e8-8f47-74fdd9f25d14 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.285775 Jun 21 18:31:59.717778 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 145/294] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:31:59 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:00.151821 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-3506a187-bf98-4594-9daf-204da0fdcb7a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Action: 'create', calling method: .version_select at 0x7fd8b8424430>, body: {"keypair": {"name": "tempest-keypair-1480547835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADbSYUtsPgqyc7hNpKQlEUPXZtiYrX0BXrBWLLFKdZ2O0xcp7FlYwk7BX8nECDM1A4MenNojw0Q3umA4grkpTziAjQSbZdb2Gw7dbw//KmxR3QhnsGdT+aP2+C92Dxm2Q=="}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:00.187467 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-3506a187-bf98-4594-9daf-204da0fdcb7a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Getting quotas for project 6538654ef94d4036a7a8d5614b80b0ed. Resources: {'key_pairs'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:32:00.194584 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-3506a187-bf98-4594-9daf-204da0fdcb7a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Getting quotas for user de09b91800314d06aeddafe3c12a77b3 and project 6538654ef94d4036a7a8d5614b80b0ed. Resources: {'key_pairs'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:32:00.260951 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-3506a187-bf98-4594-9daf-204da0fdcb7a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119112 Jun 21 18:32:00.262305 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 150/295] 10.222.0.87 () {60 vars in 1158 bytes} [Tue Jun 21 18:32:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:32:00.747902 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b9e3a9d2-10df-4bb6-b8cf-6fda4ab3a030 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:00.749095 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b9e3a9d2-10df-4bb6-b8cf-6fda4ab3a030 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:00.763745 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b9e3a9d2-10df-4bb6-b8cf-6fda4ab3a030 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:00.764599 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b9e3a9d2-10df-4bb6-b8cf-6fda4ab3a030 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:00.766384 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b9e3a9d2-10df-4bb6-b8cf-6fda4ab3a030 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:00.767225 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b9e3a9d2-10df-4bb6-b8cf-6fda4ab3a030 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:01.036390 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-b9e3a9d2-10df-4bb6-b8cf-6fda4ab3a030 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:01.057541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b9e3a9d2-10df-4bb6-b8cf-6fda4ab3a030 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.317439 Jun 21 18:32:01.059080 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 146/296] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:00 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:02.086200 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-9f17ded5-bbaf-4f03-bb81-5ec691e5022a tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:02.087334 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-9f17ded5-bbaf-4f03-bb81-5ec691e5022a tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:02.100044 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9f17ded5-bbaf-4f03-bb81-5ec691e5022a tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:02.100819 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9f17ded5-bbaf-4f03-bb81-5ec691e5022a tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:02.102242 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9f17ded5-bbaf-4f03-bb81-5ec691e5022a tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:02.103382 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9f17ded5-bbaf-4f03-bb81-5ec691e5022a tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:02.353170 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-9f17ded5-bbaf-4f03-bb81-5ec691e5022a tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:02.363529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-9f17ded5-bbaf-4f03-bb81-5ec691e5022a tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.285299 Jun 21 18:32:02.364314 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 151/297] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:02 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:02.704347 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e1323bfb-8781-4f14-ad05-15e49d24adf6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-367992840", "imageRef": "c28659fb-c2d3-4dda-a330-1323a974987e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d27fae01-b4c5-4fd5-b7cf-7de0a74abdb8"}], "security_groups": [{"name": "tempest-securitygroup--1195298470"}], "key_name": "tempest-keypair-1480547835", "user_data": "}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:03.382166 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-836b9249-432c-4b81-950a-d9f2187ac986 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:03.382996 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-836b9249-432c-4b81-950a-d9f2187ac986 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:03.391454 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-836b9249-432c-4b81-950a-d9f2187ac986 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:03.392233 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-836b9249-432c-4b81-950a-d9f2187ac986 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:03.393623 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-836b9249-432c-4b81-950a-d9f2187ac986 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:03.394484 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-836b9249-432c-4b81-950a-d9f2187ac986 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:03.592294 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-836b9249-432c-4b81-950a-d9f2187ac986 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:03.608151 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-836b9249-432c-4b81-950a-d9f2187ac986 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.229608 Jun 21 18:32:03.609243 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 152/298] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:03 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:04.632596 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-4dfa33b3-14aa-455b-b1bb-4b81b22ca8d2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:04.633821 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-4dfa33b3-14aa-455b-b1bb-4b81b22ca8d2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:04.647208 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4dfa33b3-14aa-455b-b1bb-4b81b22ca8d2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:04.648163 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4dfa33b3-14aa-455b-b1bb-4b81b22ca8d2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:04.649860 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4dfa33b3-14aa-455b-b1bb-4b81b22ca8d2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:04.650816 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4dfa33b3-14aa-455b-b1bb-4b81b22ca8d2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:04.886138 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-4dfa33b3-14aa-455b-b1bb-4b81b22ca8d2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:04.897279 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-4dfa33b3-14aa-455b-b1bb-4b81b22ca8d2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.271910 Jun 21 18:32:04.898079 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 153/299] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:04 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:05.919660 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-128238e6-0493-469d-8722-7ad54382d958 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:05.920659 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-128238e6-0493-469d-8722-7ad54382d958 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:05.929197 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-128238e6-0493-469d-8722-7ad54382d958 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:05.929730 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-128238e6-0493-469d-8722-7ad54382d958 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:05.930680 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-128238e6-0493-469d-8722-7ad54382d958 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:05.931220 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-128238e6-0493-469d-8722-7ad54382d958 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:06.152533 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-128238e6-0493-469d-8722-7ad54382d958 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:06.169827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-128238e6-0493-469d-8722-7ad54382d958 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.255918 Jun 21 18:32:06.171267 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 154/300] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:05 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:07.196835 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-467d0436-bfa0-4419-9937-36e8ee2ce7f0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:07.198096 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-467d0436-bfa0-4419-9937-36e8ee2ce7f0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:07.206810 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-467d0436-bfa0-4419-9937-36e8ee2ce7f0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:07.207265 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-467d0436-bfa0-4419-9937-36e8ee2ce7f0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:07.208076 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-467d0436-bfa0-4419-9937-36e8ee2ce7f0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:07.208509 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-467d0436-bfa0-4419-9937-36e8ee2ce7f0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:07.427147 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-467d0436-bfa0-4419-9937-36e8ee2ce7f0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:07.441358 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-467d0436-bfa0-4419-9937-36e8ee2ce7f0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.255837 Jun 21 18:32:07.442531 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 155/301] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:07 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:08.468915 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-aa541e45-949e-4825-b82f-eb46ede666e1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:08.470051 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-aa541e45-949e-4825-b82f-eb46ede666e1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:08.484278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aa541e45-949e-4825-b82f-eb46ede666e1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:08.485055 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aa541e45-949e-4825-b82f-eb46ede666e1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:08.486581 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aa541e45-949e-4825-b82f-eb46ede666e1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:08.487480 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aa541e45-949e-4825-b82f-eb46ede666e1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:08.723411 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-aa541e45-949e-4825-b82f-eb46ede666e1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:08.737846 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-aa541e45-949e-4825-b82f-eb46ede666e1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.277050 Jun 21 18:32:08.738909 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 156/302] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:08 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:09.766753 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-adf21bd5-fb51-44b2-8f5d-4f52ea885003 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:09.768792 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-adf21bd5-fb51-44b2-8f5d-4f52ea885003 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:09.781103 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-adf21bd5-fb51-44b2-8f5d-4f52ea885003 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:09.781936 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-adf21bd5-fb51-44b2-8f5d-4f52ea885003 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:09.783335 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-adf21bd5-fb51-44b2-8f5d-4f52ea885003 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:09.784111 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-adf21bd5-fb51-44b2-8f5d-4f52ea885003 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:10.021948 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-adf21bd5-fb51-44b2-8f5d-4f52ea885003 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:10.033425 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-adf21bd5-fb51-44b2-8f5d-4f52ea885003 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.274373 Jun 21 18:32:10.034167 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 157/303] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:09 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:11.043909 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=93 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:11.052619 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-453b1dcd-8ab5-44d6-b2aa-5435770d38d0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:11.053461 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-453b1dcd-8ab5-44d6-b2aa-5435770d38d0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:11.055543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=4 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:11.063937 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-453b1dcd-8ab5-44d6-b2aa-5435770d38d0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:11.064443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-453b1dcd-8ab5-44d6-b2aa-5435770d38d0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:11.065316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-453b1dcd-8ab5-44d6-b2aa-5435770d38d0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:11.065949 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-453b1dcd-8ab5-44d6-b2aa-5435770d38d0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:11.294620 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.network.neutron [None req-e1323bfb-8781-4f14-ad05-15e49d24adf6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] validate_networks() for [('d27fae01-b4c5-4fd5-b7cf-7de0a74abdb8', None, None, None, None, None)] {{(pid=118108) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:32:11.366600 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-453b1dcd-8ab5-44d6-b2aa-5435770d38d0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:11.378002 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-453b1dcd-8ab5-44d6-b2aa-5435770d38d0 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.329449 Jun 21 18:32:11.379108 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 158/304] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:11 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:11.959265 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-e1323bfb-8781-4f14-ad05-15e49d24adf6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Flavor limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:32:11.959680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-e1323bfb-8781-4f14-ad05-15e49d24adf6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Image limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:32:11.960161 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-e1323bfb-8781-4f14-ad05-15e49d24adf6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Flavor pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:32:11.960709 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-e1323bfb-8781-4f14-ad05-15e49d24adf6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Image pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:32:11.961159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-e1323bfb-8781-4f14-ad05-15e49d24adf6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:32:11.974486 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e1323bfb-8781-4f14-ad05-15e49d24adf6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:11.975179 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e1323bfb-8781-4f14-ad05-15e49d24adf6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:11.976438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e1323bfb-8781-4f14-ad05-15e49d24adf6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:11.978228 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e1323bfb-8781-4f14-ad05-15e49d24adf6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:12.015444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-e1323bfb-8781-4f14-ad05-15e49d24adf6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Getting quotas for project 6538654ef94d4036a7a8d5614b80b0ed. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:32:12.023575 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-e1323bfb-8781-4f14-ad05-15e49d24adf6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Getting quotas for user de09b91800314d06aeddafe3c12a77b3 and project 6538654ef94d4036a7a8d5614b80b0ed. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:32:12.046582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e1323bfb-8781-4f14-ad05-15e49d24adf6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Going to run 1 instances... {{(pid=118108) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:32:12.050883 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e1323bfb-8781-4f14-ad05-15e49d24adf6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c28659fb-c2d3-4dda-a330-1323a974987e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118108) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:32:12.123320 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e1323bfb-8781-4f14-ad05-15e49d24adf6 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 9.426997 Jun 21 18:32:12.124492 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 147/305] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:32:02 2022] POST /compute/v2.1/servers => generated 409 bytes in 9430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:32:12.143364 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-9f98a4b5-5918-44c3-9fdc-1e0ee5efece8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:12.144342 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-9f98a4b5-5918-44c3-9fdc-1e0ee5efece8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:12.246362 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-9f98a4b5-5918-44c3-9fdc-1e0ee5efece8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:12.256590 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-9f98a4b5-5918-44c3-9fdc-1e0ee5efece8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1245 microversion: 2.1 time: 0.121933 Jun 21 18:32:12.257613 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 159/306] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:12 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1245 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:12.408626 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-bfdaf067-454b-41c2-b0cc-31ee8f3f1eb2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:12.409317 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-bfdaf067-454b-41c2-b0cc-31ee8f3f1eb2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:12.419535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bfdaf067-454b-41c2-b0cc-31ee8f3f1eb2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:12.420355 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bfdaf067-454b-41c2-b0cc-31ee8f3f1eb2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:12.421763 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bfdaf067-454b-41c2-b0cc-31ee8f3f1eb2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:12.422467 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bfdaf067-454b-41c2-b0cc-31ee8f3f1eb2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:12.642182 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-bfdaf067-454b-41c2-b0cc-31ee8f3f1eb2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:12.652624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-bfdaf067-454b-41c2-b0cc-31ee8f3f1eb2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.250820 Jun 21 18:32:12.653387 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 148/307] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:12 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:13.280975 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-fa05dd02-fb8f-4722-ab0c-34d6e29538cd tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:13.281771 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-fa05dd02-fb8f-4722-ab0c-34d6e29538cd tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:13.292961 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fa05dd02-fb8f-4722-ab0c-34d6e29538cd tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:13.292961 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fa05dd02-fb8f-4722-ab0c-34d6e29538cd tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:13.293777 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fa05dd02-fb8f-4722-ab0c-34d6e29538cd tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:13.294287 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fa05dd02-fb8f-4722-ab0c-34d6e29538cd tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:13.382150 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-fa05dd02-fb8f-4722-ab0c-34d6e29538cd tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:13.392929 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-fa05dd02-fb8f-4722-ab0c-34d6e29538cd tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1249 microversion: 2.1 time: 0.116560 Jun 21 18:32:13.393525 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 160/308] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:13 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1249 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:13.684074 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-be5f975f-8d8e-4dd4-a753-64d0fb4136c1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:13.685179 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-be5f975f-8d8e-4dd4-a753-64d0fb4136c1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:13.694790 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-be5f975f-8d8e-4dd4-a753-64d0fb4136c1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:13.695559 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-be5f975f-8d8e-4dd4-a753-64d0fb4136c1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:13.696928 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-be5f975f-8d8e-4dd4-a753-64d0fb4136c1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:13.697565 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-be5f975f-8d8e-4dd4-a753-64d0fb4136c1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:13.912849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-be5f975f-8d8e-4dd4-a753-64d0fb4136c1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:13.928005 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-be5f975f-8d8e-4dd4-a753-64d0fb4136c1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.251390 Jun 21 18:32:13.929042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 149/309] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:13 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:14.419610 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b53cc458-c613-419f-ac12-0a29026f9787 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:14.421149 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b53cc458-c613-419f-ac12-0a29026f9787 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:14.431081 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b53cc458-c613-419f-ac12-0a29026f9787 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:14.432134 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b53cc458-c613-419f-ac12-0a29026f9787 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:14.433832 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b53cc458-c613-419f-ac12-0a29026f9787 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:14.434799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b53cc458-c613-419f-ac12-0a29026f9787 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:14.444389 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=100 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:14.552676 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b53cc458-c613-419f-ac12-0a29026f9787 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:14.565884 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b53cc458-c613-419f-ac12-0a29026f9787 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1249 microversion: 2.1 time: 0.152167 Jun 21 18:32:14.566868 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 161/310] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:14 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1249 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:14.957850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-7b7c36d0-191e-4f86-a514-a2ee61caff29 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:14.958919 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-7b7c36d0-191e-4f86-a514-a2ee61caff29 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:14.969362 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7b7c36d0-191e-4f86-a514-a2ee61caff29 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:14.970190 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7b7c36d0-191e-4f86-a514-a2ee61caff29 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:14.971582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7b7c36d0-191e-4f86-a514-a2ee61caff29 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:14.972378 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7b7c36d0-191e-4f86-a514-a2ee61caff29 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:15.212744 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-7b7c36d0-191e-4f86-a514-a2ee61caff29 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:15.228956 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-7b7c36d0-191e-4f86-a514-a2ee61caff29 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.277154 Jun 21 18:32:15.231344 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 150/311] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:14 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:15.592805 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c96faeb2-8e4d-41e5-aba6-e195e369034b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:15.593889 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c96faeb2-8e4d-41e5-aba6-e195e369034b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:15.602048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c96faeb2-8e4d-41e5-aba6-e195e369034b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:15.602781 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c96faeb2-8e4d-41e5-aba6-e195e369034b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:15.603583 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c96faeb2-8e4d-41e5-aba6-e195e369034b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:15.604411 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c96faeb2-8e4d-41e5-aba6-e195e369034b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:15.719424 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c96faeb2-8e4d-41e5-aba6-e195e369034b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:15.731839 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c96faeb2-8e4d-41e5-aba6-e195e369034b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1249 microversion: 2.1 time: 0.144216 Jun 21 18:32:15.732604 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 162/312] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:15 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1249 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:16.256930 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d30afbf1-6c34-445f-b6e8-98cb7783dfc8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:16.257598 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-d30afbf1-6c34-445f-b6e8-98cb7783dfc8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:16.265489 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d30afbf1-6c34-445f-b6e8-98cb7783dfc8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:16.266572 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d30afbf1-6c34-445f-b6e8-98cb7783dfc8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:16.267220 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d30afbf1-6c34-445f-b6e8-98cb7783dfc8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:16.268079 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d30afbf1-6c34-445f-b6e8-98cb7783dfc8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:16.484502 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-d30afbf1-6c34-445f-b6e8-98cb7783dfc8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:16.493577 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-d30afbf1-6c34-445f-b6e8-98cb7783dfc8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.240738 Jun 21 18:32:16.494768 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 151/313] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:16 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:16.754317 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8de6f60b-d704-4a16-9365-a157fed0e43f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:16.757784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8de6f60b-d704-4a16-9365-a157fed0e43f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:16.762945 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8de6f60b-d704-4a16-9365-a157fed0e43f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:16.763546 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8de6f60b-d704-4a16-9365-a157fed0e43f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:16.764449 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8de6f60b-d704-4a16-9365-a157fed0e43f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:16.764981 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8de6f60b-d704-4a16-9365-a157fed0e43f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:16.865703 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-8de6f60b-d704-4a16-9365-a157fed0e43f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:16.877062 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8de6f60b-d704-4a16-9365-a157fed0e43f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1249 microversion: 2.1 time: 0.129633 Jun 21 18:32:16.878195 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 163/314] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:16 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1249 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:17.516188 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-9143f8dc-572a-46b1-aa6c-cd038cb280e4 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:17.517173 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-9143f8dc-572a-46b1-aa6c-cd038cb280e4 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:17.528493 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9143f8dc-572a-46b1-aa6c-cd038cb280e4 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:17.529327 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9143f8dc-572a-46b1-aa6c-cd038cb280e4 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:17.530784 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9143f8dc-572a-46b1-aa6c-cd038cb280e4 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:17.531596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9143f8dc-572a-46b1-aa6c-cd038cb280e4 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:17.780815 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-9143f8dc-572a-46b1-aa6c-cd038cb280e4 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:17.795213 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-9143f8dc-572a-46b1-aa6c-cd038cb280e4 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.285026 Jun 21 18:32:17.796288 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 152/315] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:17 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:17.907247 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-0d2f601b-929f-44ef-a2b8-b44fa97ca30a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:17.908102 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-0d2f601b-929f-44ef-a2b8-b44fa97ca30a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:17.921836 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0d2f601b-929f-44ef-a2b8-b44fa97ca30a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:17.921836 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0d2f601b-929f-44ef-a2b8-b44fa97ca30a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:17.922588 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0d2f601b-929f-44ef-a2b8-b44fa97ca30a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:17.923392 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0d2f601b-929f-44ef-a2b8-b44fa97ca30a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:18.031137 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-0d2f601b-929f-44ef-a2b8-b44fa97ca30a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:18.040851 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-0d2f601b-929f-44ef-a2b8-b44fa97ca30a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1249 microversion: 2.1 time: 0.140363 Jun 21 18:32:18.041710 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 164/316] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:17 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1249 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:18.819624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-06f425cf-5e54-47c2-b5bc-d194df43c475 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:18.820736 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-06f425cf-5e54-47c2-b5bc-d194df43c475 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:18.828602 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-06f425cf-5e54-47c2-b5bc-d194df43c475 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:18.829715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-06f425cf-5e54-47c2-b5bc-d194df43c475 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:18.830478 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-06f425cf-5e54-47c2-b5bc-d194df43c475 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:18.830963 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-06f425cf-5e54-47c2-b5bc-d194df43c475 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:19.035790 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-06f425cf-5e54-47c2-b5bc-d194df43c475 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:19.051932 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-06f425cf-5e54-47c2-b5bc-d194df43c475 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.237081 Jun 21 18:32:19.052897 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 153/317] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:18 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:19.059188 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-cd68eb82-4260-4b00-b0ad-5e1930f8b4bb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:19.060062 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-cd68eb82-4260-4b00-b0ad-5e1930f8b4bb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:19.069297 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cd68eb82-4260-4b00-b0ad-5e1930f8b4bb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:19.070150 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cd68eb82-4260-4b00-b0ad-5e1930f8b4bb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:19.071578 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cd68eb82-4260-4b00-b0ad-5e1930f8b4bb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:19.072384 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cd68eb82-4260-4b00-b0ad-5e1930f8b4bb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:19.177841 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-cd68eb82-4260-4b00-b0ad-5e1930f8b4bb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:19.192068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-cd68eb82-4260-4b00-b0ad-5e1930f8b4bb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1249 microversion: 2.1 time: 0.136917 Jun 21 18:32:19.193171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 165/318] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:19 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1249 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:20.081213 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e5691c2a-72d4-4a40-96fe-f25a72dd6ec8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:20.082243 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e5691c2a-72d4-4a40-96fe-f25a72dd6ec8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:20.091229 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e5691c2a-72d4-4a40-96fe-f25a72dd6ec8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:20.091726 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e5691c2a-72d4-4a40-96fe-f25a72dd6ec8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:20.092565 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e5691c2a-72d4-4a40-96fe-f25a72dd6ec8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:20.093040 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e5691c2a-72d4-4a40-96fe-f25a72dd6ec8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:20.216674 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f96a0a15-69d6-47c6-afb1-e68cb137bef4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:20.217995 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f96a0a15-69d6-47c6-afb1-e68cb137bef4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:20.231453 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f96a0a15-69d6-47c6-afb1-e68cb137bef4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:20.246206 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f96a0a15-69d6-47c6-afb1-e68cb137bef4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:20.247797 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f96a0a15-69d6-47c6-afb1-e68cb137bef4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:20.250551 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f96a0a15-69d6-47c6-afb1-e68cb137bef4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:20.303737 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e5691c2a-72d4-4a40-96fe-f25a72dd6ec8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:20.316386 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e5691c2a-72d4-4a40-96fe-f25a72dd6ec8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.240849 Jun 21 18:32:20.317324 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 154/319] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:20 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:20.368231 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f96a0a15-69d6-47c6-afb1-e68cb137bef4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:20.381679 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f96a0a15-69d6-47c6-afb1-e68cb137bef4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1249 microversion: 2.1 time: 0.172383 Jun 21 18:32:20.382634 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 166/320] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:20 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1249 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:21.342943 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c5190a52-206d-476e-b7e9-694df6c9c71e tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:21.344053 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c5190a52-206d-476e-b7e9-694df6c9c71e tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:21.346480 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:21.354826 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c5190a52-206d-476e-b7e9-694df6c9c71e tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:21.355280 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c5190a52-206d-476e-b7e9-694df6c9c71e tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:21.356161 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c5190a52-206d-476e-b7e9-694df6c9c71e tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:21.356672 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c5190a52-206d-476e-b7e9-694df6c9c71e tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:21.413195 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2391d425-b4b7-4132-995a-d976b45eb9e4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:21.414094 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-2391d425-b4b7-4132-995a-d976b45eb9e4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:21.424849 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2391d425-b4b7-4132-995a-d976b45eb9e4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:21.425605 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2391d425-b4b7-4132-995a-d976b45eb9e4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:21.426925 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2391d425-b4b7-4132-995a-d976b45eb9e4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:21.427614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2391d425-b4b7-4132-995a-d976b45eb9e4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:21.534324 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2391d425-b4b7-4132-995a-d976b45eb9e4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:21.545800 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-2391d425-b4b7-4132-995a-d976b45eb9e4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1249 microversion: 2.1 time: 0.138418 Jun 21 18:32:21.546853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 167/321] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:21 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1249 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:21.583709 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c5190a52-206d-476e-b7e9-694df6c9c71e tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:21.597853 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c5190a52-206d-476e-b7e9-694df6c9c71e tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.261309 Jun 21 18:32:21.598486 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 155/322] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:21 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:22.573168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-57453e85-c699-4b2a-8c01-dfe86dea89b4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:22.574357 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-57453e85-c699-4b2a-8c01-dfe86dea89b4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:22.585522 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=2 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:22.606500 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-57453e85-c699-4b2a-8c01-dfe86dea89b4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:22.607234 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-57453e85-c699-4b2a-8c01-dfe86dea89b4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:22.610364 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-57453e85-c699-4b2a-8c01-dfe86dea89b4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:22.611554 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-57453e85-c699-4b2a-8c01-dfe86dea89b4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:22.627012 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b78bd5fe-6900-4d51-affb-5aee30126aa2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:22.628168 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b78bd5fe-6900-4d51-affb-5aee30126aa2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:22.637590 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=2 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:22.643191 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=6 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:22.670115 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b78bd5fe-6900-4d51-affb-5aee30126aa2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:22.671316 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b78bd5fe-6900-4d51-affb-5aee30126aa2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:22.674398 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b78bd5fe-6900-4d51-affb-5aee30126aa2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:22.680096 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b78bd5fe-6900-4d51-affb-5aee30126aa2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:22.800658 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-57453e85-c699-4b2a-8c01-dfe86dea89b4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:22.835538 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-57453e85-c699-4b2a-8c01-dfe86dea89b4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1297 microversion: 2.1 time: 0.270571 Jun 21 18:32:22.837372 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 168/323] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:22 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1297 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:23.253603 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-b78bd5fe-6900-4d51-affb-5aee30126aa2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:23.270028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b78bd5fe-6900-4d51-affb-5aee30126aa2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.650471 Jun 21 18:32:23.272652 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 156/324] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:22 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:23.868481 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f0b4d625-3e71-497a-8209-73a13b346abb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:23.869149 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f0b4d625-3e71-497a-8209-73a13b346abb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:23.877422 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f0b4d625-3e71-497a-8209-73a13b346abb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:23.878309 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f0b4d625-3e71-497a-8209-73a13b346abb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:23.879346 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f0b4d625-3e71-497a-8209-73a13b346abb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:23.879901 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f0b4d625-3e71-497a-8209-73a13b346abb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:24.008176 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f0b4d625-3e71-497a-8209-73a13b346abb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:24.024656 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f0b4d625-3e71-497a-8209-73a13b346abb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1303 microversion: 2.1 time: 0.163521 Jun 21 18:32:24.026002 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 169/325] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:23 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1303 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:24.295298 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-0357a230-c3b5-4ebe-8baa-ee8c94093e89 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:24.296267 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-0357a230-c3b5-4ebe-8baa-ee8c94093e89 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:24.311071 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0357a230-c3b5-4ebe-8baa-ee8c94093e89 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:24.311709 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0357a230-c3b5-4ebe-8baa-ee8c94093e89 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:24.313107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0357a230-c3b5-4ebe-8baa-ee8c94093e89 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:24.313757 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0357a230-c3b5-4ebe-8baa-ee8c94093e89 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:24.665817 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-0357a230-c3b5-4ebe-8baa-ee8c94093e89 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:24.679766 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-0357a230-c3b5-4ebe-8baa-ee8c94093e89 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.389573 Jun 21 18:32:24.681249 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 157/326] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:24 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:25.052314 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f1d9fa7b-fe9e-4972-91f8-dab05f9e8f9e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:25.064173 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f1d9fa7b-fe9e-4972-91f8-dab05f9e8f9e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:25.112302 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f1d9fa7b-fe9e-4972-91f8-dab05f9e8f9e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:25.116519 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f1d9fa7b-fe9e-4972-91f8-dab05f9e8f9e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:25.120955 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f1d9fa7b-fe9e-4972-91f8-dab05f9e8f9e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:25.125520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f1d9fa7b-fe9e-4972-91f8-dab05f9e8f9e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:25.503145 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-3450a9aa-a11a-4c6a-bbd8-7e7805b1b0c6 req-2005a594-bcae-433e-98dc-dfa9699a85f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e78643f-ce2e-456f-80ed-10bb952f6095", "name": "network-vif-plugged", "status": "completed", "tag": "4922e0a8-97f2-4634-b22d-bd075ac21184"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:25.553874 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-3450a9aa-a11a-4c6a-bbd8-7e7805b1b0c6 req-2005a594-bcae-433e-98dc-dfa9699a85f6 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:25.560746 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-3450a9aa-a11a-4c6a-bbd8-7e7805b1b0c6 req-2005a594-bcae-433e-98dc-dfa9699a85f6 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:25.564598 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f1d9fa7b-fe9e-4972-91f8-dab05f9e8f9e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:25.596518 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f1d9fa7b-fe9e-4972-91f8-dab05f9e8f9e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.554682 Jun 21 18:32:25.597301 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 170/327] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:25 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:25.617386 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-3450a9aa-a11a-4c6a-bbd8-7e7805b1b0c6 req-2005a594-bcae-433e-98dc-dfa9699a85f6 service nova] Creating event network-vif-plugged:4922e0a8-97f2-4634-b22d-bd075ac21184 for instance 8e78643f-ce2e-456f-80ed-10bb952f6095 on hv-cinder-84460 Jun 21 18:32:25.638513 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-3450a9aa-a11a-4c6a-bbd8-7e7805b1b0c6 req-2005a594-bcae-433e-98dc-dfa9699a85f6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142216 Jun 21 18:32:25.640373 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 158/328] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:32:25.704597 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8f3d6b4a-5367-4ba7-88bb-cfe25cae72cc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:25.705315 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8f3d6b4a-5367-4ba7-88bb-cfe25cae72cc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:25.712833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8f3d6b4a-5367-4ba7-88bb-cfe25cae72cc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:25.714506 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8f3d6b4a-5367-4ba7-88bb-cfe25cae72cc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:25.716101 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8f3d6b4a-5367-4ba7-88bb-cfe25cae72cc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:25.716985 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8f3d6b4a-5367-4ba7-88bb-cfe25cae72cc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:26.100263 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-8f3d6b4a-5367-4ba7-88bb-cfe25cae72cc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:26.124475 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8f3d6b4a-5367-4ba7-88bb-cfe25cae72cc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.426846 Jun 21 18:32:26.127070 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 171/329] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:25 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:26.451004 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-b6b22abb-7f79-4f3e-aab4-59c014eb1fdd req-96dbe7e9-c74c-4f1a-911c-fa4d0a9e2ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2aebe7-f120-48fd-8aa0-7e91b857e1cc", "tag": "fbfe0125-66e4-4f30-a67a-e407b7aed936"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:26.491954 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-b6b22abb-7f79-4f3e-aab4-59c014eb1fdd req-96dbe7e9-c74c-4f1a-911c-fa4d0a9e2ba8 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:26.492732 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-b6b22abb-7f79-4f3e-aab4-59c014eb1fdd req-96dbe7e9-c74c-4f1a-911c-fa4d0a9e2ba8 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:26.517552 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-b6b22abb-7f79-4f3e-aab4-59c014eb1fdd req-96dbe7e9-c74c-4f1a-911c-fa4d0a9e2ba8 service nova] Creating event network-changed:fbfe0125-66e4-4f30-a67a-e407b7aed936 for instance 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc on hv-cinder-84460 Jun 21 18:32:26.527622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-b6b22abb-7f79-4f3e-aab4-59c014eb1fdd req-96dbe7e9-c74c-4f1a-911c-fa4d0a9e2ba8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083456 Jun 21 18:32:26.528915 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 159/330] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:32:26.631463 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b44f8c00-7854-40a1-86a9-557a3f872478 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:26.632648 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b44f8c00-7854-40a1-86a9-557a3f872478 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:26.656649 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b44f8c00-7854-40a1-86a9-557a3f872478 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:26.659613 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b44f8c00-7854-40a1-86a9-557a3f872478 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:26.660998 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b44f8c00-7854-40a1-86a9-557a3f872478 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:26.661869 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b44f8c00-7854-40a1-86a9-557a3f872478 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:26.960827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b44f8c00-7854-40a1-86a9-557a3f872478 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:26.972587 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b44f8c00-7854-40a1-86a9-557a3f872478 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.350392 Jun 21 18:32:26.973527 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 172/331] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:26 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:27.149008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-8af2b1a3-1094-4492-ae0f-d5ff03222424 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:27.150310 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-8af2b1a3-1094-4492-ae0f-d5ff03222424 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:27.158866 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8af2b1a3-1094-4492-ae0f-d5ff03222424 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:27.159526 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8af2b1a3-1094-4492-ae0f-d5ff03222424 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:27.160484 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8af2b1a3-1094-4492-ae0f-d5ff03222424 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:27.160962 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8af2b1a3-1094-4492-ae0f-d5ff03222424 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:27.662478 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-8af2b1a3-1094-4492-ae0f-d5ff03222424 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:27.672333 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-8af2b1a3-1094-4492-ae0f-d5ff03222424 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.530823 Jun 21 18:32:27.673111 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 160/332] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:27 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:27.999532 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1df71cd4-b03c-4019-9e16-6aaae7f079cf tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:28.000938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1df71cd4-b03c-4019-9e16-6aaae7f079cf tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:28.012051 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1df71cd4-b03c-4019-9e16-6aaae7f079cf tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:28.012799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1df71cd4-b03c-4019-9e16-6aaae7f079cf tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:28.015073 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1df71cd4-b03c-4019-9e16-6aaae7f079cf tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:28.015073 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1df71cd4-b03c-4019-9e16-6aaae7f079cf tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:28.217843 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1df71cd4-b03c-4019-9e16-6aaae7f079cf tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:28.226299 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1df71cd4-b03c-4019-9e16-6aaae7f079cf tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.234536 Jun 21 18:32:28.227736 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 173/333] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:27 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:28.691195 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a89ba87c-3f8a-496d-b1bb-b2d19162db45 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:28.692161 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-a89ba87c-3f8a-496d-b1bb-b2d19162db45 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:28.699028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a89ba87c-3f8a-496d-b1bb-b2d19162db45 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:28.699472 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a89ba87c-3f8a-496d-b1bb-b2d19162db45 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:28.700269 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a89ba87c-3f8a-496d-b1bb-b2d19162db45 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:28.700701 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a89ba87c-3f8a-496d-b1bb-b2d19162db45 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:28.885236 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-a89ba87c-3f8a-496d-b1bb-b2d19162db45 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:28.895190 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a89ba87c-3f8a-496d-b1bb-b2d19162db45 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.208191 Jun 21 18:32:28.895890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 161/334] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:28 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:29.252928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-4aa885e5-488c-4e3e-a83d-4144b3717942 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:29.254072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-4aa885e5-488c-4e3e-a83d-4144b3717942 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:29.256690 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:29.262852 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4aa885e5-488c-4e3e-a83d-4144b3717942 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:29.263303 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4aa885e5-488c-4e3e-a83d-4144b3717942 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:29.264129 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4aa885e5-488c-4e3e-a83d-4144b3717942 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:29.264569 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4aa885e5-488c-4e3e-a83d-4144b3717942 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:29.430747 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-4aa885e5-488c-4e3e-a83d-4144b3717942 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:29.439285 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-4aa885e5-488c-4e3e-a83d-4144b3717942 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.193074 Jun 21 18:32:29.439954 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 174/335] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:29 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:29.915231 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4ae59728-ba7e-4cdf-aea8-e538d37b65fc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:29.916640 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4ae59728-ba7e-4cdf-aea8-e538d37b65fc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:29.923307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4ae59728-ba7e-4cdf-aea8-e538d37b65fc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:29.923753 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4ae59728-ba7e-4cdf-aea8-e538d37b65fc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:29.924550 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4ae59728-ba7e-4cdf-aea8-e538d37b65fc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:29.924995 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4ae59728-ba7e-4cdf-aea8-e538d37b65fc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:30.147340 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-4ae59728-ba7e-4cdf-aea8-e538d37b65fc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:30.159172 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4ae59728-ba7e-4cdf-aea8-e538d37b65fc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.248616 Jun 21 18:32:30.160005 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 162/336] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:29 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:30.459154 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-26e8e728-4387-4020-9e51-87ec883278d5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:30.461107 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-26e8e728-4387-4020-9e51-87ec883278d5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:30.490221 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-26e8e728-4387-4020-9e51-87ec883278d5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:30.491020 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-26e8e728-4387-4020-9e51-87ec883278d5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:30.492400 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-26e8e728-4387-4020-9e51-87ec883278d5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:30.493470 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-26e8e728-4387-4020-9e51-87ec883278d5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:30.700879 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-26e8e728-4387-4020-9e51-87ec883278d5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:30.714015 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-26e8e728-4387-4020-9e51-87ec883278d5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.260175 Jun 21 18:32:30.715347 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 175/337] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:30 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:31.185910 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-1bc2630e-8593-47c3-9cfe-055464ed7ba1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:31.187054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-1bc2630e-8593-47c3-9cfe-055464ed7ba1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:31.195490 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1bc2630e-8593-47c3-9cfe-055464ed7ba1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:31.196417 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1bc2630e-8593-47c3-9cfe-055464ed7ba1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:31.198278 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1bc2630e-8593-47c3-9cfe-055464ed7ba1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:31.199035 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1bc2630e-8593-47c3-9cfe-055464ed7ba1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:31.426002 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-1bc2630e-8593-47c3-9cfe-055464ed7ba1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:31.438799 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-1bc2630e-8593-47c3-9cfe-055464ed7ba1 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.258504 Jun 21 18:32:31.439711 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 163/338] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:31 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:31.742912 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-7e9930e6-acb3-4e2d-8c2e-8664867ec513 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:31.743969 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-7e9930e6-acb3-4e2d-8c2e-8664867ec513 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:31.752621 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7e9930e6-acb3-4e2d-8c2e-8664867ec513 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:31.753203 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7e9930e6-acb3-4e2d-8c2e-8664867ec513 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:31.754249 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7e9930e6-acb3-4e2d-8c2e-8664867ec513 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:31.754732 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7e9930e6-acb3-4e2d-8c2e-8664867ec513 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:31.936052 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-7e9930e6-acb3-4e2d-8c2e-8664867ec513 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:31.944346 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-7e9930e6-acb3-4e2d-8c2e-8664867ec513 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.207380 Jun 21 18:32:31.944956 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 176/339] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:31 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:32.466136 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e107c0c7-4712-41b5-820e-6c1331df6b87 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:32.467359 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e107c0c7-4712-41b5-820e-6c1331df6b87 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:32.479464 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e107c0c7-4712-41b5-820e-6c1331df6b87 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:32.480279 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e107c0c7-4712-41b5-820e-6c1331df6b87 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:32.481822 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e107c0c7-4712-41b5-820e-6c1331df6b87 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:32.482613 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e107c0c7-4712-41b5-820e-6c1331df6b87 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:32.709304 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e107c0c7-4712-41b5-820e-6c1331df6b87 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:32.723084 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e107c0c7-4712-41b5-820e-6c1331df6b87 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.264498 Jun 21 18:32:32.723632 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 164/340] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:32 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:32.966355 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-896dfe34-8083-4101-a140-9ff31b31050a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:32.967683 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-896dfe34-8083-4101-a140-9ff31b31050a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:32.975580 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-896dfe34-8083-4101-a140-9ff31b31050a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:32.975919 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-896dfe34-8083-4101-a140-9ff31b31050a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:32.977069 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-896dfe34-8083-4101-a140-9ff31b31050a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:32.977577 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-896dfe34-8083-4101-a140-9ff31b31050a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:33.209069 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-896dfe34-8083-4101-a140-9ff31b31050a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:33.213154 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=100 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:33.221977 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-896dfe34-8083-4101-a140-9ff31b31050a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.262699 Jun 21 18:32:33.222565 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 177/341] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:32 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:33.749921 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-51a76867-0677-4e9b-baf4-c6f9ce70b32b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:33.750656 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-51a76867-0677-4e9b-baf4-c6f9ce70b32b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:33.760400 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-51a76867-0677-4e9b-baf4-c6f9ce70b32b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:33.761177 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-51a76867-0677-4e9b-baf4-c6f9ce70b32b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:33.762233 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-51a76867-0677-4e9b-baf4-c6f9ce70b32b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:33.762841 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-51a76867-0677-4e9b-baf4-c6f9ce70b32b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:33.804782 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=100 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:33.991444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-51a76867-0677-4e9b-baf4-c6f9ce70b32b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:34.004752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-51a76867-0677-4e9b-baf4-c6f9ce70b32b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.259472 Jun 21 18:32:34.005579 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 165/342] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:33 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:34.246614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-fd8ebaaf-0f2d-43b4-8424-98f266af1d81 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:34.247725 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-fd8ebaaf-0f2d-43b4-8424-98f266af1d81 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:34.260128 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fd8ebaaf-0f2d-43b4-8424-98f266af1d81 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:34.260896 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fd8ebaaf-0f2d-43b4-8424-98f266af1d81 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:34.262321 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fd8ebaaf-0f2d-43b4-8424-98f266af1d81 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:34.263011 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fd8ebaaf-0f2d-43b4-8424-98f266af1d81 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:34.480775 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-fd8ebaaf-0f2d-43b4-8424-98f266af1d81 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:34.489698 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-fd8ebaaf-0f2d-43b4-8424-98f266af1d81 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.250046 Jun 21 18:32:34.490358 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 178/343] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:34 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:35.030815 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6877775d-9742-4000-9b62-2a8084c126f7 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:35.031810 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-6877775d-9742-4000-9b62-2a8084c126f7 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:35.038661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6877775d-9742-4000-9b62-2a8084c126f7 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:35.039165 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6877775d-9742-4000-9b62-2a8084c126f7 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:35.040149 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6877775d-9742-4000-9b62-2a8084c126f7 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:35.040575 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6877775d-9742-4000-9b62-2a8084c126f7 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:35.206290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6877775d-9742-4000-9b62-2a8084c126f7 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:35.215275 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6877775d-9742-4000-9b62-2a8084c126f7 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.189747 Jun 21 18:32:35.215948 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 166/344] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:35 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:35.508643 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-7ed3d1b9-f20b-4f7b-8895-ed59a599f678 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:35.509616 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-7ed3d1b9-f20b-4f7b-8895-ed59a599f678 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:35.519154 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7ed3d1b9-f20b-4f7b-8895-ed59a599f678 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:35.519709 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7ed3d1b9-f20b-4f7b-8895-ed59a599f678 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:35.520635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7ed3d1b9-f20b-4f7b-8895-ed59a599f678 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:35.521164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7ed3d1b9-f20b-4f7b-8895-ed59a599f678 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:35.709684 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-7ed3d1b9-f20b-4f7b-8895-ed59a599f678 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:35.718711 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-7ed3d1b9-f20b-4f7b-8895-ed59a599f678 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.214659 Jun 21 18:32:35.719466 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 179/345] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:35 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:36.242946 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c84dde90-6e60-4d2d-aa64-fa79617d0e4d tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:36.244174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c84dde90-6e60-4d2d-aa64-fa79617d0e4d tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:36.251938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c84dde90-6e60-4d2d-aa64-fa79617d0e4d tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:36.252380 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c84dde90-6e60-4d2d-aa64-fa79617d0e4d tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:36.253175 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c84dde90-6e60-4d2d-aa64-fa79617d0e4d tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:36.253608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c84dde90-6e60-4d2d-aa64-fa79617d0e4d tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:36.458718 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c84dde90-6e60-4d2d-aa64-fa79617d0e4d tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:36.469240 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c84dde90-6e60-4d2d-aa64-fa79617d0e4d tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.231873 Jun 21 18:32:36.469862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 167/346] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:36 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:36.748765 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c2c12a6f-2f76-499e-ae4c-e3335cf3f752 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:36.749873 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c2c12a6f-2f76-499e-ae4c-e3335cf3f752 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:36.761700 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c2c12a6f-2f76-499e-ae4c-e3335cf3f752 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:36.762233 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c2c12a6f-2f76-499e-ae4c-e3335cf3f752 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:36.763808 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c2c12a6f-2f76-499e-ae4c-e3335cf3f752 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:36.764721 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c2c12a6f-2f76-499e-ae4c-e3335cf3f752 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:37.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c2c12a6f-2f76-499e-ae4c-e3335cf3f752 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:37.014868 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c2c12a6f-2f76-499e-ae4c-e3335cf3f752 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.272399 Jun 21 18:32:37.015950 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 180/347] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:36 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:37.492444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-dc0bc1a0-eac4-472f-9a5c-c634cfa3d38b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:37.493712 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-dc0bc1a0-eac4-472f-9a5c-c634cfa3d38b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:37.505590 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dc0bc1a0-eac4-472f-9a5c-c634cfa3d38b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:37.505590 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dc0bc1a0-eac4-472f-9a5c-c634cfa3d38b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:37.506466 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dc0bc1a0-eac4-472f-9a5c-c634cfa3d38b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:37.507075 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dc0bc1a0-eac4-472f-9a5c-c634cfa3d38b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:37.792465 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-dc0bc1a0-eac4-472f-9a5c-c634cfa3d38b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:37.806377 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-dc0bc1a0-eac4-472f-9a5c-c634cfa3d38b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1313 microversion: 2.1 time: 0.320559 Jun 21 18:32:37.806759 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 168/348] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:37 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:38.035285 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-cbecd819-211f-4f15-9600-c50e03ec879d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:38.036092 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-cbecd819-211f-4f15-9600-c50e03ec879d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:38.047231 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cbecd819-211f-4f15-9600-c50e03ec879d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:38.047936 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cbecd819-211f-4f15-9600-c50e03ec879d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:38.049419 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cbecd819-211f-4f15-9600-c50e03ec879d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:38.050243 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cbecd819-211f-4f15-9600-c50e03ec879d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:38.153768 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-98763b61-c41c-4660-bf86-8449c2699c12 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1228532952", "imageRef": "c28659fb-c2d3-4dda-a330-1323a974987e", "flavorRef": "452"}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:38.231037 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.network.neutron [None req-98763b61-c41c-4660-bf86-8449c2699c12 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] validate_networks() for None {{(pid=118108) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:32:38.385531 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-cbecd819-211f-4f15-9600-c50e03ec879d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:38.399576 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-cbecd819-211f-4f15-9600-c50e03ec879d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.368971 Jun 21 18:32:38.400793 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 181/349] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:38 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:38.834221 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-066196ae-1c7b-49cc-911b-2d4fe7eefa45 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:38.835258 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-066196ae-1c7b-49cc-911b-2d4fe7eefa45 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:38.852581 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-066196ae-1c7b-49cc-911b-2d4fe7eefa45 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:38.853274 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-066196ae-1c7b-49cc-911b-2d4fe7eefa45 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:38.854978 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-066196ae-1c7b-49cc-911b-2d4fe7eefa45 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:38.855821 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-066196ae-1c7b-49cc-911b-2d4fe7eefa45 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:38.907985 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-98763b61-c41c-4660-bf86-8449c2699c12 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Flavor limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:32:38.908573 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-98763b61-c41c-4660-bf86-8449c2699c12 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Image limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:32:38.908914 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-98763b61-c41c-4660-bf86-8449c2699c12 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Flavor pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:32:38.909328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-98763b61-c41c-4660-bf86-8449c2699c12 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Image pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:32:38.909871 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-98763b61-c41c-4660-bf86-8449c2699c12 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:32:38.922623 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-98763b61-c41c-4660-bf86-8449c2699c12 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:38.923444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-98763b61-c41c-4660-bf86-8449c2699c12 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:38.924625 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-98763b61-c41c-4660-bf86-8449c2699c12 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:38.925253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-98763b61-c41c-4660-bf86-8449c2699c12 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:38.950731 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-98763b61-c41c-4660-bf86-8449c2699c12 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Getting quotas for project b5569463610e44dc82d15553cbbcb02c. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:32:38.956245 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-98763b61-c41c-4660-bf86-8449c2699c12 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Getting quotas for user 2bbfa51f793c4d2fb53ce386f4d33192 and project b5569463610e44dc82d15553cbbcb02c. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:32:38.971962 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-98763b61-c41c-4660-bf86-8449c2699c12 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Going to run 1 instances... {{(pid=118108) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:32:38.974612 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-98763b61-c41c-4660-bf86-8449c2699c12 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c28659fb-c2d3-4dda-a330-1323a974987e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118108) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:32:39.040975 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-98763b61-c41c-4660-bf86-8449c2699c12 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895278 Jun 21 18:32:39.041499 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 169/350] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:32:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:32:39.057422 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-961965d0-446b-498e-9de3-418205156c00 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:39.058337 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-961965d0-446b-498e-9de3-418205156c00 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:39.159048 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-961965d0-446b-498e-9de3-418205156c00 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:39.168853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-066196ae-1c7b-49cc-911b-2d4fe7eefa45 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:39.171819 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-961965d0-446b-498e-9de3-418205156c00 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1215 microversion: 2.1 time: 0.119701 Jun 21 18:32:39.175964 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 170/351] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:39 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1215 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:39.187055 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-066196ae-1c7b-49cc-911b-2d4fe7eefa45 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1497 microversion: 2.1 time: 0.358442 Jun 21 18:32:39.187916 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 182/352] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:38 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1497 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:39.422970 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-debb95f0-8589-4497-8bc6-cfdc3449208f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:39.424384 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-debb95f0-8589-4497-8bc6-cfdc3449208f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:39.437981 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-debb95f0-8589-4497-8bc6-cfdc3449208f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:39.439204 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-debb95f0-8589-4497-8bc6-cfdc3449208f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:39.440501 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-debb95f0-8589-4497-8bc6-cfdc3449208f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:39.441422 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-debb95f0-8589-4497-8bc6-cfdc3449208f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:39.699487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-debb95f0-8589-4497-8bc6-cfdc3449208f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:39.717054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-debb95f0-8589-4497-8bc6-cfdc3449208f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.300063 Jun 21 18:32:39.719163 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 171/353] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:39 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:40.189923 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1b193e49-a6d5-4b4a-be4c-e47423a08a67 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:40.191204 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1b193e49-a6d5-4b4a-be4c-e47423a08a67 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:40.202450 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b193e49-a6d5-4b4a-be4c-e47423a08a67 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:40.203227 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b193e49-a6d5-4b4a-be4c-e47423a08a67 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:40.204658 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b193e49-a6d5-4b4a-be4c-e47423a08a67 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:40.205429 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b193e49-a6d5-4b4a-be4c-e47423a08a67 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:40.315440 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1b193e49-a6d5-4b4a-be4c-e47423a08a67 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:40.329468 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1b193e49-a6d5-4b4a-be4c-e47423a08a67 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1219 microversion: 2.1 time: 0.143121 Jun 21 18:32:40.330744 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 183/354] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:40 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:40.743276 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-84158640-08ad-4de4-8ab8-e251de4728ec tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:40.744146 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-84158640-08ad-4de4-8ab8-e251de4728ec tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:40.753368 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-84158640-08ad-4de4-8ab8-e251de4728ec tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:40.754014 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-84158640-08ad-4de4-8ab8-e251de4728ec tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:40.755164 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-84158640-08ad-4de4-8ab8-e251de4728ec tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:40.755788 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-84158640-08ad-4de4-8ab8-e251de4728ec tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:40.952937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-84158640-08ad-4de4-8ab8-e251de4728ec tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:40.963851 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-84158640-08ad-4de4-8ab8-e251de4728ec tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.226712 Jun 21 18:32:40.964862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 172/355] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:40 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:41.355898 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b674405f-e1ce-4beb-9420-b9cf539f0e9a tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:41.356881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b674405f-e1ce-4beb-9420-b9cf539f0e9a tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:41.364676 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b674405f-e1ce-4beb-9420-b9cf539f0e9a tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:41.365316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b674405f-e1ce-4beb-9420-b9cf539f0e9a tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:41.366643 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b674405f-e1ce-4beb-9420-b9cf539f0e9a tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:41.367169 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b674405f-e1ce-4beb-9420-b9cf539f0e9a tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:41.478199 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b674405f-e1ce-4beb-9420-b9cf539f0e9a tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:41.490760 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b674405f-e1ce-4beb-9420-b9cf539f0e9a tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1219 microversion: 2.1 time: 0.140010 Jun 21 18:32:41.491358 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 184/356] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:41 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:41.988530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-21a02103-f26e-4656-8119-c18724dce2d3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:41.989533 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-21a02103-f26e-4656-8119-c18724dce2d3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:42.001051 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-21a02103-f26e-4656-8119-c18724dce2d3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:42.001842 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-21a02103-f26e-4656-8119-c18724dce2d3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:42.002957 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-21a02103-f26e-4656-8119-c18724dce2d3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:42.003548 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-21a02103-f26e-4656-8119-c18724dce2d3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:42.162794 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-21a02103-f26e-4656-8119-c18724dce2d3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:42.170881 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-21a02103-f26e-4656-8119-c18724dce2d3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.189090 Jun 21 18:32:42.171812 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 173/357] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:41 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:42.516747 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-7b2274e2-9250-441b-a76d-372fc1c45d10 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:42.517561 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-7b2274e2-9250-441b-a76d-372fc1c45d10 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:42.532770 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7b2274e2-9250-441b-a76d-372fc1c45d10 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:42.533310 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7b2274e2-9250-441b-a76d-372fc1c45d10 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:42.534751 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7b2274e2-9250-441b-a76d-372fc1c45d10 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:42.535453 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7b2274e2-9250-441b-a76d-372fc1c45d10 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:42.644124 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-7b2274e2-9250-441b-a76d-372fc1c45d10 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:42.658001 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-7b2274e2-9250-441b-a76d-372fc1c45d10 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1219 microversion: 2.1 time: 0.145329 Jun 21 18:32:42.659344 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 185/358] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:42 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:43.201755 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-528281e1-2374-4131-97c8-4549f963f96c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:43.203107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-528281e1-2374-4131-97c8-4549f963f96c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:43.214957 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-528281e1-2374-4131-97c8-4549f963f96c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:43.215773 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-528281e1-2374-4131-97c8-4549f963f96c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:43.217193 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-528281e1-2374-4131-97c8-4549f963f96c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:43.218037 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-528281e1-2374-4131-97c8-4549f963f96c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:43.461216 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-528281e1-2374-4131-97c8-4549f963f96c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:43.477922 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-528281e1-2374-4131-97c8-4549f963f96c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.283480 Jun 21 18:32:43.478986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 174/359] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:43 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:43.679259 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-90f4e334-57f7-4d86-a06e-bdb9f8920b6c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:43.680123 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-90f4e334-57f7-4d86-a06e-bdb9f8920b6c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:43.690021 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-90f4e334-57f7-4d86-a06e-bdb9f8920b6c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:43.690755 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-90f4e334-57f7-4d86-a06e-bdb9f8920b6c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:43.691741 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-90f4e334-57f7-4d86-a06e-bdb9f8920b6c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:43.692292 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-90f4e334-57f7-4d86-a06e-bdb9f8920b6c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:43.799911 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-90f4e334-57f7-4d86-a06e-bdb9f8920b6c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:43.811523 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-90f4e334-57f7-4d86-a06e-bdb9f8920b6c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1219 microversion: 2.1 time: 0.137386 Jun 21 18:32:43.812279 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 186/360] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:43 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:44.506799 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2553908f-44d9-4a2b-b4c3-3d3a81ae5f2b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:44.507710 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-2553908f-44d9-4a2b-b4c3-3d3a81ae5f2b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:44.518338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2553908f-44d9-4a2b-b4c3-3d3a81ae5f2b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:44.519007 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2553908f-44d9-4a2b-b4c3-3d3a81ae5f2b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:44.520217 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2553908f-44d9-4a2b-b4c3-3d3a81ae5f2b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:44.520900 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2553908f-44d9-4a2b-b4c3-3d3a81ae5f2b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:44.756975 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2553908f-44d9-4a2b-b4c3-3d3a81ae5f2b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:44.767426 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2553908f-44d9-4a2b-b4c3-3d3a81ae5f2b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.267036 Jun 21 18:32:44.768328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 175/361] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:44 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:44.837046 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bcad0252-f1d5-45e4-8cdb-17409df2a7c5 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:44.837046 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-bcad0252-f1d5-45e4-8cdb-17409df2a7c5 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:44.844855 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bcad0252-f1d5-45e4-8cdb-17409df2a7c5 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:44.845533 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bcad0252-f1d5-45e4-8cdb-17409df2a7c5 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:44.846564 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bcad0252-f1d5-45e4-8cdb-17409df2a7c5 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:44.847100 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bcad0252-f1d5-45e4-8cdb-17409df2a7c5 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:44.918924 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-bcad0252-f1d5-45e4-8cdb-17409df2a7c5 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:44.935415 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-bcad0252-f1d5-45e4-8cdb-17409df2a7c5 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1219 microversion: 2.1 time: 0.106724 Jun 21 18:32:44.936213 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 187/362] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:44 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:45.789038 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-94a9cc0e-93d1-42a5-89d9-2c51e142b781 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:45.790104 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-94a9cc0e-93d1-42a5-89d9-2c51e142b781 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:45.799242 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-94a9cc0e-93d1-42a5-89d9-2c51e142b781 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:45.800069 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-94a9cc0e-93d1-42a5-89d9-2c51e142b781 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:45.801478 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-94a9cc0e-93d1-42a5-89d9-2c51e142b781 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:45.802295 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-94a9cc0e-93d1-42a5-89d9-2c51e142b781 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:45.960929 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-37f4bf6f-72c8-4a66-93c5-688c4efee6ae tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:45.961956 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-37f4bf6f-72c8-4a66-93c5-688c4efee6ae tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:45.969126 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-37f4bf6f-72c8-4a66-93c5-688c4efee6ae tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:45.969582 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-37f4bf6f-72c8-4a66-93c5-688c4efee6ae tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:45.970759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-37f4bf6f-72c8-4a66-93c5-688c4efee6ae tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:45.971414 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-37f4bf6f-72c8-4a66-93c5-688c4efee6ae tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:46.032938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-94a9cc0e-93d1-42a5-89d9-2c51e142b781 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:46.053167 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-94a9cc0e-93d1-42a5-89d9-2c51e142b781 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.267092 Jun 21 18:32:46.059814 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 176/363] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:45 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:46.088931 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-37f4bf6f-72c8-4a66-93c5-688c4efee6ae tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:46.104797 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-37f4bf6f-72c8-4a66-93c5-688c4efee6ae tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1219 microversion: 2.1 time: 0.148116 Jun 21 18:32:46.105940 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 188/364] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:45 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:46.501791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-0e16b20e-3b1d-4053-9593-5565163a9a4c tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:46.502341 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-0e16b20e-3b1d-4053-9593-5565163a9a4c tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:46.512435 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0e16b20e-3b1d-4053-9593-5565163a9a4c tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:46.514130 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0e16b20e-3b1d-4053-9593-5565163a9a4c tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:46.517793 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0e16b20e-3b1d-4053-9593-5565163a9a4c tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:46.519311 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0e16b20e-3b1d-4053-9593-5565163a9a4c tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:46.562140 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-0e16b20e-3b1d-4053-9593-5565163a9a4c tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Going to try to terminate instance {{(pid=118108) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:32:46.684526 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-0e16b20e-3b1d-4053-9593-5565163a9a4c tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "DELETE /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 204 len: 0 microversion: 2.1 time: 0.186334 Jun 21 18:32:46.685435 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 177/365] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:32:46 2022] DELETE /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 18:32:46.698785 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8c1963c3-e697-4928-a256-50e21ff269e6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:46.699472 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8c1963c3-e697-4928-a256-50e21ff269e6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:46.707876 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8c1963c3-e697-4928-a256-50e21ff269e6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:46.708555 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8c1963c3-e697-4928-a256-50e21ff269e6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:46.709440 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8c1963c3-e697-4928-a256-50e21ff269e6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:46.710271 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8c1963c3-e697-4928-a256-50e21ff269e6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:46.912335 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-8c1963c3-e697-4928-a256-50e21ff269e6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:46.923387 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8c1963c3-e697-4928-a256-50e21ff269e6 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1503 microversion: 2.1 time: 0.230675 Jun 21 18:32:46.923944 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 189/366] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:46 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1503 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:47.080621 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a4549816-f1e6-4772-9175-52163f501a2d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:47.082028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-a4549816-f1e6-4772-9175-52163f501a2d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:47.090643 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a4549816-f1e6-4772-9175-52163f501a2d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:47.091274 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a4549816-f1e6-4772-9175-52163f501a2d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:47.092642 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a4549816-f1e6-4772-9175-52163f501a2d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:47.093723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a4549816-f1e6-4772-9175-52163f501a2d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:47.131256 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1650e69f-3c2f-4a5d-9e81-22b5a764f987 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:47.132202 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1650e69f-3c2f-4a5d-9e81-22b5a764f987 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:47.143453 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1650e69f-3c2f-4a5d-9e81-22b5a764f987 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:47.144244 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1650e69f-3c2f-4a5d-9e81-22b5a764f987 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:47.145767 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1650e69f-3c2f-4a5d-9e81-22b5a764f987 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:47.146448 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1650e69f-3c2f-4a5d-9e81-22b5a764f987 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:47.277304 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1650e69f-3c2f-4a5d-9e81-22b5a764f987 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:47.301462 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1650e69f-3c2f-4a5d-9e81-22b5a764f987 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1219 microversion: 2.1 time: 0.175876 Jun 21 18:32:47.302740 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 190/367] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:47 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1219 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:47.368911 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-a4549816-f1e6-4772-9175-52163f501a2d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:47.379043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a4549816-f1e6-4772-9175-52163f501a2d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.306343 Jun 21 18:32:47.379640 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 178/368] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:47 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:47.947586 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-560e1773-6bd8-46ce-9b74-a21cd9e1aa53 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:47.948529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-560e1773-6bd8-46ce-9b74-a21cd9e1aa53 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:47.958554 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-560e1773-6bd8-46ce-9b74-a21cd9e1aa53 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:47.959280 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-560e1773-6bd8-46ce-9b74-a21cd9e1aa53 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:47.960386 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-560e1773-6bd8-46ce-9b74-a21cd9e1aa53 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:47.961216 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-560e1773-6bd8-46ce-9b74-a21cd9e1aa53 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:48.185842 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-560e1773-6bd8-46ce-9b74-a21cd9e1aa53 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:48.198981 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-560e1773-6bd8-46ce-9b74-a21cd9e1aa53 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1503 microversion: 2.1 time: 0.257658 Jun 21 18:32:48.199877 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 191/369] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:47 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1503 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:48.333602 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f0530de0-6d43-4823-b180-5ea2d16e03af tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:48.334407 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f0530de0-6d43-4823-b180-5ea2d16e03af tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:48.351328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f0530de0-6d43-4823-b180-5ea2d16e03af tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:48.353857 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f0530de0-6d43-4823-b180-5ea2d16e03af tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:48.355183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f0530de0-6d43-4823-b180-5ea2d16e03af tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:48.355968 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f0530de0-6d43-4823-b180-5ea2d16e03af tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:48.401572 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-aa072324-eeff-4f8a-ad66-0f6a63d32c15 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:48.402486 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-aa072324-eeff-4f8a-ad66-0f6a63d32c15 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:48.409474 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aa072324-eeff-4f8a-ad66-0f6a63d32c15 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:48.410048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aa072324-eeff-4f8a-ad66-0f6a63d32c15 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:48.410905 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aa072324-eeff-4f8a-ad66-0f6a63d32c15 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:48.411410 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aa072324-eeff-4f8a-ad66-0f6a63d32c15 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:48.441115 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f0530de0-6d43-4823-b180-5ea2d16e03af tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:48.452803 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f0530de0-6d43-4823-b180-5ea2d16e03af tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1219 microversion: 2.1 time: 0.129162 Jun 21 18:32:48.459343 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 179/370] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:48 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:48.630261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-aa072324-eeff-4f8a-ad66-0f6a63d32c15 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:48.642781 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-aa072324-eeff-4f8a-ad66-0f6a63d32c15 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.245744 Jun 21 18:32:48.643375 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 192/371] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:48 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:49.219230 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-cf12c740-a096-4e1f-aa95-c4ebd08b17a3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:49.219979 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-cf12c740-a096-4e1f-aa95-c4ebd08b17a3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:49.222450 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=2 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:49.223651 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=8 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:49.235063 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cf12c740-a096-4e1f-aa95-c4ebd08b17a3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:49.235755 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cf12c740-a096-4e1f-aa95-c4ebd08b17a3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:49.237145 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cf12c740-a096-4e1f-aa95-c4ebd08b17a3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:49.238043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cf12c740-a096-4e1f-aa95-c4ebd08b17a3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:49.476730 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-cf12c740-a096-4e1f-aa95-c4ebd08b17a3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:49.479394 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1b88b0be-cb22-4fb5-8b4c-8979220f3b4f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:49.480397 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1b88b0be-cb22-4fb5-8b4c-8979220f3b4f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:49.486514 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-cf12c740-a096-4e1f-aa95-c4ebd08b17a3 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1503 microversion: 2.1 time: 0.271216 Jun 21 18:32:49.487370 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 180/372] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:49 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1503 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:49.500848 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b88b0be-cb22-4fb5-8b4c-8979220f3b4f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:49.501586 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b88b0be-cb22-4fb5-8b4c-8979220f3b4f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:49.503013 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b88b0be-cb22-4fb5-8b4c-8979220f3b4f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:49.503792 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b88b0be-cb22-4fb5-8b4c-8979220f3b4f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:49.608895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1b88b0be-cb22-4fb5-8b4c-8979220f3b4f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:49.622085 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1b88b0be-cb22-4fb5-8b4c-8979220f3b4f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1219 microversion: 2.1 time: 0.148992 Jun 21 18:32:49.622833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 193/373] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:49 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:49.665604 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-8f15da12-5a95-4a77-9689-e0a42c78bd30 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:49.666220 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-8f15da12-5a95-4a77-9689-e0a42c78bd30 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:49.673072 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8f15da12-5a95-4a77-9689-e0a42c78bd30 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:49.673655 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8f15da12-5a95-4a77-9689-e0a42c78bd30 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:49.674354 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8f15da12-5a95-4a77-9689-e0a42c78bd30 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:49.674844 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8f15da12-5a95-4a77-9689-e0a42c78bd30 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:49.879609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-8f15da12-5a95-4a77-9689-e0a42c78bd30 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:49.888251 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-8f15da12-5a95-4a77-9689-e0a42c78bd30 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.227728 Jun 21 18:32:49.888841 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 181/374] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:49 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:50.509038 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-54b6dea3-5f46-462f-a2a3-7e58d020b25b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:50.510058 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-54b6dea3-5f46-462f-a2a3-7e58d020b25b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:50.519339 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-54b6dea3-5f46-462f-a2a3-7e58d020b25b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:50.520121 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-54b6dea3-5f46-462f-a2a3-7e58d020b25b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:50.521479 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-54b6dea3-5f46-462f-a2a3-7e58d020b25b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:50.522290 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-54b6dea3-5f46-462f-a2a3-7e58d020b25b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:50.547695 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=100 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:50.642752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5aa498dd-2f85-4e87-80f1-2ee6d9c8fe22 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:50.643899 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-5aa498dd-2f85-4e87-80f1-2ee6d9c8fe22 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:50.653069 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5aa498dd-2f85-4e87-80f1-2ee6d9c8fe22 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:50.653539 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5aa498dd-2f85-4e87-80f1-2ee6d9c8fe22 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:50.654376 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5aa498dd-2f85-4e87-80f1-2ee6d9c8fe22 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:50.654814 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5aa498dd-2f85-4e87-80f1-2ee6d9c8fe22 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:50.660077 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:50.782588 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-5aa498dd-2f85-4e87-80f1-2ee6d9c8fe22 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:50.791313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-54b6dea3-5f46-462f-a2a3-7e58d020b25b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:50.796547 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-5aa498dd-2f85-4e87-80f1-2ee6d9c8fe22 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1219 microversion: 2.1 time: 0.158183 Jun 21 18:32:50.797404 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 182/375] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:50 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1219 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:50.805823 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-54b6dea3-5f46-462f-a2a3-7e58d020b25b tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1503 microversion: 2.1 time: 0.301691 Jun 21 18:32:50.807025 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 194/376] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:50 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1503 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:50.919628 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-cf7d0968-d8de-4b3c-8889-43f173cfe875 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:50.920698 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-cf7d0968-d8de-4b3c-8889-43f173cfe875 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:50.932139 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cf7d0968-d8de-4b3c-8889-43f173cfe875 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:50.932911 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cf7d0968-d8de-4b3c-8889-43f173cfe875 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:50.934246 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cf7d0968-d8de-4b3c-8889-43f173cfe875 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:50.934742 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cf7d0968-d8de-4b3c-8889-43f173cfe875 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:51.134789 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-cf7d0968-d8de-4b3c-8889-43f173cfe875 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:51.146533 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-cf7d0968-d8de-4b3c-8889-43f173cfe875 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.235151 Jun 21 18:32:51.147494 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 183/377] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:50 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:51.826337 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bf5b6fd1-dbea-430c-8e0a-ffe46cf4bf32 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:51.828583 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-bf5b6fd1-dbea-430c-8e0a-ffe46cf4bf32 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:51.838785 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bf5b6fd1-dbea-430c-8e0a-ffe46cf4bf32 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:51.839588 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bf5b6fd1-dbea-430c-8e0a-ffe46cf4bf32 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:51.840471 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bf5b6fd1-dbea-430c-8e0a-ffe46cf4bf32 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:51.841147 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bf5b6fd1-dbea-430c-8e0a-ffe46cf4bf32 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:51.846784 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-fef181c1-bcca-4ca2-bfcd-1b717b6c04e4 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:51.851006 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-fef181c1-bcca-4ca2-bfcd-1b717b6c04e4 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:51.855271 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:51.862872 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fef181c1-bcca-4ca2-bfcd-1b717b6c04e4 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:51.863841 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fef181c1-bcca-4ca2-bfcd-1b717b6c04e4 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:51.865479 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fef181c1-bcca-4ca2-bfcd-1b717b6c04e4 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:51.866266 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fef181c1-bcca-4ca2-bfcd-1b717b6c04e4 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:51.958459 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-bf5b6fd1-dbea-430c-8e0a-ffe46cf4bf32 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:51.971352 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-bf5b6fd1-dbea-430c-8e0a-ffe46cf4bf32 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1219 microversion: 2.1 time: 0.155724 Jun 21 18:32:51.974750 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 195/378] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:51 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1219 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:52.129477 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-fef181c1-bcca-4ca2-bfcd-1b717b6c04e4 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:52.142347 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-fef181c1-bcca-4ca2-bfcd-1b717b6c04e4 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1503 microversion: 2.1 time: 0.309207 Jun 21 18:32:52.144515 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 184/379] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:51 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1503 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:52.171557 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6b3601b0-976a-42aa-b0b7-7f8a0df0e444 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:52.173062 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6b3601b0-976a-42aa-b0b7-7f8a0df0e444 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:52.184072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6b3601b0-976a-42aa-b0b7-7f8a0df0e444 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:52.184804 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6b3601b0-976a-42aa-b0b7-7f8a0df0e444 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:52.185826 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6b3601b0-976a-42aa-b0b7-7f8a0df0e444 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:52.186907 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6b3601b0-976a-42aa-b0b7-7f8a0df0e444 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:52.353941 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-539bf5cd-f0b4-41f0-8758-c990a8d18242 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83be0bf0-8245-444d-b864-96b7714bf805", "device": "/dev/sdb"}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:52.357047 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-539bf5cd-f0b4-41f0-8758-c990a8d18242 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:52.369683 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-539bf5cd-f0b4-41f0-8758-c990a8d18242 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:52.370524 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-539bf5cd-f0b4-41f0-8758-c990a8d18242 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:52.372214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-539bf5cd-f0b4-41f0-8758-c990a8d18242 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:52.373389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-539bf5cd-f0b4-41f0-8758-c990a8d18242 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:52.455895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-6b3601b0-976a-42aa-b0b7-7f8a0df0e444 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:52.469806 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6b3601b0-976a-42aa-b0b7-7f8a0df0e444 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.305502 Jun 21 18:32:52.470754 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 196/380] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:52 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:52.994241 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-60d1b1f2-5511-47f0-8bcb-3a2d0c6c6ce9 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:52.995163 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-60d1b1f2-5511-47f0-8bcb-3a2d0c6c6ce9 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:53.003138 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-60d1b1f2-5511-47f0-8bcb-3a2d0c6c6ce9 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:53.003610 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-60d1b1f2-5511-47f0-8bcb-3a2d0c6c6ce9 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:53.004391 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-60d1b1f2-5511-47f0-8bcb-3a2d0c6c6ce9 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:53.004826 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-60d1b1f2-5511-47f0-8bcb-3a2d0c6c6ce9 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:53.095722 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-60d1b1f2-5511-47f0-8bcb-3a2d0c6c6ce9 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:53.111348 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-60d1b1f2-5511-47f0-8bcb-3a2d0c6c6ce9 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1219 microversion: 2.1 time: 0.121917 Jun 21 18:32:53.112352 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 197/381] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:52 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1219 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:53.164027 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-0422ec4a-01ad-4689-a34b-9a9fc4582fbc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:53.164941 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-0422ec4a-01ad-4689-a34b-9a9fc4582fbc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:53.174916 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0422ec4a-01ad-4689-a34b-9a9fc4582fbc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:53.176013 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0422ec4a-01ad-4689-a34b-9a9fc4582fbc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:53.177385 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0422ec4a-01ad-4689-a34b-9a9fc4582fbc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:53.178267 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0422ec4a-01ad-4689-a34b-9a9fc4582fbc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:53.648279 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-0422ec4a-01ad-4689-a34b-9a9fc4582fbc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:53.661899 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-0422ec4a-01ad-4689-a34b-9a9fc4582fbc tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1503 microversion: 2.1 time: 0.503017 Jun 21 18:32:53.664124 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 198/382] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:53 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1503 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:53.699797 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c8a50731-6144-4027-984d-806a33311325 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:53.711001 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c8a50731-6144-4027-984d-806a33311325 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:53.735208 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c8a50731-6144-4027-984d-806a33311325 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:53.738128 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c8a50731-6144-4027-984d-806a33311325 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:53.739964 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c8a50731-6144-4027-984d-806a33311325 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:53.741355 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c8a50731-6144-4027-984d-806a33311325 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:53.754082 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-539bf5cd-f0b4-41f0-8758-c990a8d18242 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "POST /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.407797 Jun 21 18:32:53.768292 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 185/383] 10.222.0.87 () {60 vars in 1322 bytes} [Tue Jun 21 18:32:52 2022] POST /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3/os-volume_attachments => generated 194 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:32:54.105622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-3d94bc67-d639-4003-978d-be8b006197cf req-bf7c2617-fde0-48bb-820c-89fe5c56045d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2aebe7-f120-48fd-8aa0-7e91b857e1cc", "name": "network-vif-plugged", "status": "completed", "tag": "fbfe0125-66e4-4f30-a67a-e407b7aed936"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:54.145521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-3d94bc67-d639-4003-978d-be8b006197cf req-bf7c2617-fde0-48bb-820c-89fe5c56045d service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:54.151544 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-3d94bc67-d639-4003-978d-be8b006197cf req-bf7c2617-fde0-48bb-820c-89fe5c56045d service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:54.194063 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-3d94bc67-d639-4003-978d-be8b006197cf req-bf7c2617-fde0-48bb-820c-89fe5c56045d service nova] Creating event network-vif-plugged:fbfe0125-66e4-4f30-a67a-e407b7aed936 for instance 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc on hv-cinder-84460 Jun 21 18:32:54.217341 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-3d94bc67-d639-4003-978d-be8b006197cf req-bf7c2617-fde0-48bb-820c-89fe5c56045d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120693 Jun 21 18:32:54.219254 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 186/384] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:32:54.231713 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-9cd11d55-3403-4f61-88c6-1e23b5a1bc62 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:54.233882 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-9cd11d55-3403-4f61-88c6-1e23b5a1bc62 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:54.253085 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9cd11d55-3403-4f61-88c6-1e23b5a1bc62 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:54.254795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9cd11d55-3403-4f61-88c6-1e23b5a1bc62 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:54.258014 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9cd11d55-3403-4f61-88c6-1e23b5a1bc62 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:54.259453 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9cd11d55-3403-4f61-88c6-1e23b5a1bc62 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:54.318687 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c8a50731-6144-4027-984d-806a33311325 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:54.336512 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c8a50731-6144-4027-984d-806a33311325 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.658913 Jun 21 18:32:54.338219 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 199/385] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:53 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:54.386380 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-9cd11d55-3403-4f61-88c6-1e23b5a1bc62 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:54.431434 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-9cd11d55-3403-4f61-88c6-1e23b5a1bc62 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1267 microversion: 2.1 time: 0.207761 Jun 21 18:32:54.433027 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 187/386] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:54 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:54.691443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a806cd75-9e64-4fb5-bc3b-ee5b09e70ba8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:54.699032 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-a806cd75-9e64-4fb5-bc3b-ee5b09e70ba8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:54.742109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a806cd75-9e64-4fb5-bc3b-ee5b09e70ba8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:54.744527 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a806cd75-9e64-4fb5-bc3b-ee5b09e70ba8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:54.751090 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a806cd75-9e64-4fb5-bc3b-ee5b09e70ba8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:54.752843 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a806cd75-9e64-4fb5-bc3b-ee5b09e70ba8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:55.371221 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4c02a393-954b-47e7-8e4c-90028003ab12 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:55.373133 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4c02a393-954b-47e7-8e4c-90028003ab12 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:55.388200 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4c02a393-954b-47e7-8e4c-90028003ab12 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:55.389337 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4c02a393-954b-47e7-8e4c-90028003ab12 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:55.391085 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4c02a393-954b-47e7-8e4c-90028003ab12 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:55.392002 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4c02a393-954b-47e7-8e4c-90028003ab12 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:55.687615 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-a806cd75-9e64-4fb5-bc3b-ee5b09e70ba8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:55.711528 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-a806cd75-9e64-4fb5-bc3b-ee5b09e70ba8 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1503 microversion: 2.1 time: 1.029880 Jun 21 18:32:55.716533 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 200/387] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:54 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1503 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:55.729132 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a8f20a39-8bce-4662-8f1a-0adde80e67b4 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:55.731006 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-a8f20a39-8bce-4662-8f1a-0adde80e67b4 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:55.747776 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a8f20a39-8bce-4662-8f1a-0adde80e67b4 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:55.748934 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a8f20a39-8bce-4662-8f1a-0adde80e67b4 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:55.751561 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a8f20a39-8bce-4662-8f1a-0adde80e67b4 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:55.752621 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a8f20a39-8bce-4662-8f1a-0adde80e67b4 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:55.775715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-4c02a393-954b-47e7-8e4c-90028003ab12 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:55.791809 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4c02a393-954b-47e7-8e4c-90028003ab12 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.433043 Jun 21 18:32:55.806375 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 188/388] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:55 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:55.878628 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-a8f20a39-8bce-4662-8f1a-0adde80e67b4 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:55.898218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-a8f20a39-8bce-4662-8f1a-0adde80e67b4 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1273 microversion: 2.1 time: 0.179100 Jun 21 18:32:55.899502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 201/389] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:55 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1273 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:56.746312 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a495c924-d334-4882-9a42-69cd98f1febe tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:56.748491 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-a495c924-d334-4882-9a42-69cd98f1febe tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:56.756940 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a495c924-d334-4882-9a42-69cd98f1febe tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:56.757514 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a495c924-d334-4882-9a42-69cd98f1febe tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:56.758737 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a495c924-d334-4882-9a42-69cd98f1febe tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:56.759363 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a495c924-d334-4882-9a42-69cd98f1febe tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:56.823658 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-659c67b6-23c7-45c4-ab9d-1e62ce814f5a req-7c215013-d94a-4700-9cd5-162e4cef58e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e78643f-ce2e-456f-80ed-10bb952f6095", "name": "network-vif-deleted", "tag": "4922e0a8-97f2-4634-b22d-bd075ac21184"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:32:56.846752 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-659c67b6-23c7-45c4-ab9d-1e62ce814f5a req-7c215013-d94a-4700-9cd5-162e4cef58e8 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:56.848030 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-659c67b6-23c7-45c4-ab9d-1e62ce814f5a req-7c215013-d94a-4700-9cd5-162e4cef58e8 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:56.888043 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-659c67b6-23c7-45c4-ab9d-1e62ce814f5a req-7c215013-d94a-4700-9cd5-162e4cef58e8 service nova] Creating event network-vif-deleted:4922e0a8-97f2-4634-b22d-bd075ac21184 for instance 8e78643f-ce2e-456f-80ed-10bb952f6095 on hv-cinder-84460 Jun 21 18:32:56.897243 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-659c67b6-23c7-45c4-ab9d-1e62ce814f5a req-7c215013-d94a-4700-9cd5-162e4cef58e8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080133 Jun 21 18:32:56.899165 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 202/390] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:32:56.900448 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-a495c924-d334-4882-9a42-69cd98f1febe tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:56.907848 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a2d67f7c-73e4-46aa-aba9-ae6cd67e4136 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:56.908845 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-a2d67f7c-73e4-46aa-aba9-ae6cd67e4136 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:56.917453 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a2d67f7c-73e4-46aa-aba9-ae6cd67e4136 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:56.918192 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a2d67f7c-73e4-46aa-aba9-ae6cd67e4136 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:56.919428 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a2d67f7c-73e4-46aa-aba9-ae6cd67e4136 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:56.920492 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a2d67f7c-73e4-46aa-aba9-ae6cd67e4136 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:56.924249 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a495c924-d334-4882-9a42-69cd98f1febe tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1461 microversion: 2.1 time: 0.185102 Jun 21 18:32:56.926160 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 189/391] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:56 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1461 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:56.958435 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-1c1a2c5e-96b4-4810-8551-c39446357038 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:56.966836 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-1c1a2c5e-96b4-4810-8551-c39446357038 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:56.992246 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1c1a2c5e-96b4-4810-8551-c39446357038 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:56.994365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1c1a2c5e-96b4-4810-8551-c39446357038 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:56.996749 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1c1a2c5e-96b4-4810-8551-c39446357038 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:56.999581 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1c1a2c5e-96b4-4810-8551-c39446357038 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:57.242567 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-1c1a2c5e-96b4-4810-8551-c39446357038 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:57.260043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-1c1a2c5e-96b4-4810-8551-c39446357038 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1273 microversion: 2.1 time: 0.309315 Jun 21 18:32:57.261510 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 190/392] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:56 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1273 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:57.587739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-a2d67f7c-73e4-46aa-aba9-ae6cd67e4136 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:57.645842 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-a2d67f7c-73e4-46aa-aba9-ae6cd67e4136 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1371 microversion: 2.1 time: 0.743783 Jun 21 18:32:57.646853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 203/393] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:56 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1371 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:57.963107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-7d9a1739-3992-44b2-8142-6dad04611846 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:57.965542 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-7d9a1739-3992-44b2-8142-6dad04611846 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:57.980440 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7d9a1739-3992-44b2-8142-6dad04611846 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:57.981838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7d9a1739-3992-44b2-8142-6dad04611846 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:57.983272 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7d9a1739-3992-44b2-8142-6dad04611846 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:57.984620 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7d9a1739-3992-44b2-8142-6dad04611846 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:58.051338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7d9a1739-3992-44b2-8142-6dad04611846 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:58.051979 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7d9a1739-3992-44b2-8142-6dad04611846 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:58.052463 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.objects.instance [None req-7d9a1739-3992-44b2-8142-6dad04611846 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lazy-loading 'fault' on Instance uuid 8e78643f-ce2e-456f-80ed-10bb952f6095 {{(pid=118108) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:32:58.128347 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-7d9a1739-3992-44b2-8142-6dad04611846 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:58.140482 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-7d9a1739-3992-44b2-8142-6dad04611846 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1303 microversion: 2.1 time: 0.186051 Jun 21 18:32:58.141758 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 191/394] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:57 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1303 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:32:58.283112 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-21dc7e14-85b6-4f5b-a623-42660290b8d4 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:58.283986 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-21dc7e14-85b6-4f5b-a623-42660290b8d4 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:58.293830 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-21dc7e14-85b6-4f5b-a623-42660290b8d4 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:58.294434 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-21dc7e14-85b6-4f5b-a623-42660290b8d4 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:58.295248 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-21dc7e14-85b6-4f5b-a623-42660290b8d4 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:58.295709 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-21dc7e14-85b6-4f5b-a623-42660290b8d4 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:58.473406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-21dc7e14-85b6-4f5b-a623-42660290b8d4 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:58.486215 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-21dc7e14-85b6-4f5b-a623-42660290b8d4 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.208159 Jun 21 18:32:58.487193 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 204/395] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:58 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:58.676290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-06b98118-0d58-415e-ba02-601318188919 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:58.677239 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-06b98118-0d58-415e-ba02-601318188919 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:58.688462 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-06b98118-0d58-415e-ba02-601318188919 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:58.689126 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-06b98118-0d58-415e-ba02-601318188919 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:58.690495 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-06b98118-0d58-415e-ba02-601318188919 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:58.691238 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-06b98118-0d58-415e-ba02-601318188919 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:58.907981 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-06b98118-0d58-415e-ba02-601318188919 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:58.922444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-06b98118-0d58-415e-ba02-601318188919 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1565 microversion: 2.1 time: 0.250357 Jun 21 18:32:58.923452 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 192/396] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:58 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1565 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:58.948256 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-612976c8-1013-4e61-b99b-226e91f6e03d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:58.949124 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-612976c8-1013-4e61-b99b-226e91f6e03d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:58.960821 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-612976c8-1013-4e61-b99b-226e91f6e03d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:58.964899 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-612976c8-1013-4e61-b99b-226e91f6e03d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:58.964899 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-612976c8-1013-4e61-b99b-226e91f6e03d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:58.964899 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-612976c8-1013-4e61-b99b-226e91f6e03d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:59.076336 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-612976c8-1013-4e61-b99b-226e91f6e03d tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135591 Jun 21 18:32:59.077254 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 205/397] 10.222.0.87 () {58 vars in 1274 bytes} [Tue Jun 21 18:32:58 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:32:59.165935 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-caaf581d-d99a-45cc-a393-2c3ffd8b7fae tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:59.166886 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-caaf581d-d99a-45cc-a393-2c3ffd8b7fae tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:59.176972 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-caaf581d-d99a-45cc-a393-2c3ffd8b7fae tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:59.177576 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-caaf581d-d99a-45cc-a393-2c3ffd8b7fae tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:59.179011 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-caaf581d-d99a-45cc-a393-2c3ffd8b7fae tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:59.179718 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-caaf581d-d99a-45cc-a393-2c3ffd8b7fae tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:59.236980 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-caaf581d-d99a-45cc-a393-2c3ffd8b7fae tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:59.237814 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-caaf581d-d99a-45cc-a393-2c3ffd8b7fae tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:59.238584 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.objects.instance [None req-caaf581d-d99a-45cc-a393-2c3ffd8b7fae tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lazy-loading 'fault' on Instance uuid 8e78643f-ce2e-456f-80ed-10bb952f6095 {{(pid=118108) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:32:59.307409 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-caaf581d-d99a-45cc-a393-2c3ffd8b7fae tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:59.318394 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-caaf581d-d99a-45cc-a393-2c3ffd8b7fae tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1303 microversion: 2.1 time: 0.159659 Jun 21 18:32:59.319871 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 193/398] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:59 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1303 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:32:59.509949 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e54cc985-019f-4911-858d-5fda895952a6 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:32:59.511319 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e54cc985-019f-4911-858d-5fda895952a6 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:32:59.515990 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=64 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:32:59.528339 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e54cc985-019f-4911-858d-5fda895952a6 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:59.529177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e54cc985-019f-4911-858d-5fda895952a6 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:59.530697 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e54cc985-019f-4911-858d-5fda895952a6 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:32:59.531505 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e54cc985-019f-4911-858d-5fda895952a6 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:32:59.803943 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e54cc985-019f-4911-858d-5fda895952a6 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:32:59.830140 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e54cc985-019f-4911-858d-5fda895952a6 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.325031 Jun 21 18:32:59.831074 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 206/399] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:32:59 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:00.348494 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-89bd10f2-7ca9-4667-8212-6ce787b2b5cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:00.349613 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-89bd10f2-7ca9-4667-8212-6ce787b2b5cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:00.362645 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-89bd10f2-7ca9-4667-8212-6ce787b2b5cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:00.363444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-89bd10f2-7ca9-4667-8212-6ce787b2b5cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:00.364888 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-89bd10f2-7ca9-4667-8212-6ce787b2b5cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:00.365716 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-89bd10f2-7ca9-4667-8212-6ce787b2b5cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:00.423457 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-89bd10f2-7ca9-4667-8212-6ce787b2b5cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:00.423911 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-89bd10f2-7ca9-4667-8212-6ce787b2b5cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:00.424370 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.objects.instance [None req-89bd10f2-7ca9-4667-8212-6ce787b2b5cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lazy-loading 'fault' on Instance uuid 8e78643f-ce2e-456f-80ed-10bb952f6095 {{(pid=118108) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:33:00.483551 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-89bd10f2-7ca9-4667-8212-6ce787b2b5cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:00.497923 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-89bd10f2-7ca9-4667-8212-6ce787b2b5cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1303 microversion: 2.1 time: 0.156493 Jun 21 18:33:00.507603 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 194/400] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:00 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1303 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:00.858902 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-4f36f93b-c732-43be-9e4b-c3d94659bf36 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:00.862184 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-4f36f93b-c732-43be-9e4b-c3d94659bf36 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:00.869758 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4f36f93b-c732-43be-9e4b-c3d94659bf36 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:00.870280 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4f36f93b-c732-43be-9e4b-c3d94659bf36 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:00.871631 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4f36f93b-c732-43be-9e4b-c3d94659bf36 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:00.872097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4f36f93b-c732-43be-9e4b-c3d94659bf36 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:01.113452 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-4f36f93b-c732-43be-9e4b-c3d94659bf36 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:01.122999 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-4f36f93b-c732-43be-9e4b-c3d94659bf36 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.270002 Jun 21 18:33:01.129033 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 207/401] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:00 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:01.528064 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-093449a6-17b4-4f38-acc0-0b7e8a9c3cb2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:01.529709 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-093449a6-17b4-4f38-acc0-0b7e8a9c3cb2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:01.556025 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-093449a6-17b4-4f38-acc0-0b7e8a9c3cb2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:01.559951 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-093449a6-17b4-4f38-acc0-0b7e8a9c3cb2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:01.563807 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-093449a6-17b4-4f38-acc0-0b7e8a9c3cb2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:01.564972 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-093449a6-17b4-4f38-acc0-0b7e8a9c3cb2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:01.708241 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-093449a6-17b4-4f38-acc0-0b7e8a9c3cb2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:01.709028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-093449a6-17b4-4f38-acc0-0b7e8a9c3cb2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:01.711212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.objects.instance [None req-093449a6-17b4-4f38-acc0-0b7e8a9c3cb2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lazy-loading 'fault' on Instance uuid 8e78643f-ce2e-456f-80ed-10bb952f6095 {{(pid=118108) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:33:01.808357 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-a23d1028-31b8-445a-98b2-ea84e9edfd4e req-05e05372-1bc6-4b35-8914-bb606d0917b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2aebe7-f120-48fd-8aa0-7e91b857e1cc", "tag": "fbfe0125-66e4-4f30-a67a-e407b7aed936"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:01.869735 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-a23d1028-31b8-445a-98b2-ea84e9edfd4e req-05e05372-1bc6-4b35-8914-bb606d0917b0 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:01.872221 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-a23d1028-31b8-445a-98b2-ea84e9edfd4e req-05e05372-1bc6-4b35-8914-bb606d0917b0 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:01.924146 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-093449a6-17b4-4f38-acc0-0b7e8a9c3cb2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c323bc7a8c45e39714bb3e7f401c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0307481a33be4b268d2793bb65f9d9ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:01.931352 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-a23d1028-31b8-445a-98b2-ea84e9edfd4e req-05e05372-1bc6-4b35-8914-bb606d0917b0 service nova] Creating event network-changed:fbfe0125-66e4-4f30-a67a-e407b7aed936 for instance 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc on hv-cinder-84460 Jun 21 18:33:01.955458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-a23d1028-31b8-445a-98b2-ea84e9edfd4e req-05e05372-1bc6-4b35-8914-bb606d0917b0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150404 Jun 21 18:33:01.955749 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-093449a6-17b4-4f38-acc0-0b7e8a9c3cb2 tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 200 len: 1303 microversion: 2.1 time: 0.425725 Jun 21 18:33:01.957515 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 208/402] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:33:01.959205 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 195/403] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:01 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 1303 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:33:02.146208 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a5ad418f-2418-4faa-a856-c331d8dabbb9 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:02.147722 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-a5ad418f-2418-4faa-a856-c331d8dabbb9 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:02.158864 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a5ad418f-2418-4faa-a856-c331d8dabbb9 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:02.161319 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a5ad418f-2418-4faa-a856-c331d8dabbb9 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:02.170729 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a5ad418f-2418-4faa-a856-c331d8dabbb9 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:02.171917 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a5ad418f-2418-4faa-a856-c331d8dabbb9 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:02.523061 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-a5ad418f-2418-4faa-a856-c331d8dabbb9 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:02.529563 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:02.537238 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a5ad418f-2418-4faa-a856-c331d8dabbb9 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.398079 Jun 21 18:33:02.546224 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 196/404] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:02 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:02.991209 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bb99ce8c-7059-4129-a55a-701640af14cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:02.993983 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-bb99ce8c-7059-4129-a55a-701640af14cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] [instance: 8e78643f-ce2e-456f-80ed-10bb952f6095] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:03.014510 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bb99ce8c-7059-4129-a55a-701640af14cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:03.015503 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bb99ce8c-7059-4129-a55a-701640af14cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:03.017023 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bb99ce8c-7059-4129-a55a-701640af14cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:03.017843 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bb99ce8c-7059-4129-a55a-701640af14cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:03.044671 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-bb99ce8c-7059-4129-a55a-701640af14cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] HTTP exception thrown: Instance 8e78643f-ce2e-456f-80ed-10bb952f6095 could not be found. Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bb99ce8c-7059-4129-a55a-701640af14cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Request method failure captured: Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 HTTP/1.1 Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg5b85-0Pk-59iMvKhG4wDc804N2hlGI1NYnsBz1tE4aqqkGOZjYjJbisfLw0g92aEQ4iDyrYw_T_8U351WxKzlYC7DlIiSZsgnen7emWHZPgf7q2DRP_Z8Iv81D9kNucl8an__KBWU_O2rKRDgLwLqJ8UmeAeCsf0kkTwIe6JA75QA Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 0307481a33be4b268d2793bb65f9d9ef Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-VolumesActionsTest-1158214866 Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:33:03.048218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:33:03.051168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0307481a33be4b268d2793bb65f9d9ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/0307481a33be4b268d2793bb65f9d9ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/0307481a33be4b268d2793bb65f9d9ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_0307481a33be4b268d2793bb65f9d9ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:33:03.051168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-VolumesActionsTest-1158214866 Jun 21 18:33:03.051168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 0307481a33be4b268d2793bb65f9d9ef Jun 21 18:33:03.051168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-VolumesActionsTest-1158214866 Jun 21 18:33:03.051168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-VolumesActionsTest-1158214866-project Jun 21 18:33:03.051168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:33:03.051168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:33:03.051168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: 82c323bc7a8c45e39714bb3e7f401c3a Jun 21 18:33:03.051168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-VolumesActionsTest-1158214866-project Jun 21 18:33:03.051168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:33:03.051168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance 8e78643f-ce2e-456f-80ed-10bb952f6095 could not be found. Jun 21 18:33:03.051168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': '8e78643f-ce2e-456f-80ed-10bb952f6095'} Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e78643f-ce2e-456f-80ed-10bb952f6095 could not be found. Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:33:03.052723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:33:03.055395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:33:03.055395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:33:03.055395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:33:03.055395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:33:03.055395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:33:03.055395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:33:03.055395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:33:03.055395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e78643f-ce2e-456f-80ed-10bb952f6095 could not be found. Jun 21 18:33:03.055395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:33:03.055395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:03.055395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:33:03.055395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:03.055395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:03.055395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:03.055395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:33:03.055395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:33:03.055395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e78643f-ce2e-456f-80ed-10bb952f6095 could not be found. Jun 21 18:33:03.055395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:33:03.059201 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bb99ce8c-7059-4129-a55a-701640af14cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] Returning 404 to user: Instance 8e78643f-ce2e-456f-80ed-10bb952f6095 could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:33:03.061161 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-bb99ce8c-7059-4129-a55a-701640af14cb tempest-VolumesActionsTest-1158214866 tempest-VolumesActionsTest-1158214866-project] 10.222.0.87 "GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095" status: 404 len: 111 microversion: 2.1 time: 0.079799 Jun 21 18:33:03.063000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 209/405] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:02 2022] GET /compute/v2.1/servers/8e78643f-ce2e-456f-80ed-10bb952f6095 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:33:03.576166 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2e5052fc-6b6c-4765-8883-6979783df175 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:03.579525 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-2e5052fc-6b6c-4765-8883-6979783df175 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:03.598077 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e5052fc-6b6c-4765-8883-6979783df175 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:03.600779 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e5052fc-6b6c-4765-8883-6979783df175 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:03.610595 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e5052fc-6b6c-4765-8883-6979783df175 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:03.611190 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e5052fc-6b6c-4765-8883-6979783df175 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:03.925675 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2e5052fc-6b6c-4765-8883-6979783df175 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:03.960068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2e5052fc-6b6c-4765-8883-6979783df175 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.393982 Jun 21 18:33:03.965157 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 197/406] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:03 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:03.987186 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-2e16539e-bc50-4bc1-b332-7fed28075390 req-34f626bd-c43e-42f6-a49e-2dc48afa588e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d48898ad-34bd-484c-bc46-35060c0b0e58", "tag": "5b21b4b0-ce30-4b99-b116-75f298aa0fdf"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:04.003783 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-2e16539e-bc50-4bc1-b332-7fed28075390 req-34f626bd-c43e-42f6-a49e-2dc48afa588e service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:04.004815 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-2e16539e-bc50-4bc1-b332-7fed28075390 req-34f626bd-c43e-42f6-a49e-2dc48afa588e service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:04.022439 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-2e16539e-bc50-4bc1-b332-7fed28075390 req-34f626bd-c43e-42f6-a49e-2dc48afa588e service nova] Creating event network-changed:5b21b4b0-ce30-4b99-b116-75f298aa0fdf for instance d48898ad-34bd-484c-bc46-35060c0b0e58 on hv-cinder-84460 Jun 21 18:33:04.030365 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-2e16539e-bc50-4bc1-b332-7fed28075390 req-34f626bd-c43e-42f6-a49e-2dc48afa588e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049181 Jun 21 18:33:04.032358 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 210/407] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:33:05.023312 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-fd881459-56d3-4060-90cb-2bc68f9a8c0b tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:05.026776 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-fd881459-56d3-4060-90cb-2bc68f9a8c0b tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:05.049870 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fd881459-56d3-4060-90cb-2bc68f9a8c0b tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:05.051965 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fd881459-56d3-4060-90cb-2bc68f9a8c0b tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:05.054235 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fd881459-56d3-4060-90cb-2bc68f9a8c0b tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:05.055405 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fd881459-56d3-4060-90cb-2bc68f9a8c0b tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:05.341731 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-fd881459-56d3-4060-90cb-2bc68f9a8c0b tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:05.354616 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-fd881459-56d3-4060-90cb-2bc68f9a8c0b tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.361759 Jun 21 18:33:05.356338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 198/408] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:04 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:06.386045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-04df2974-faab-4f8f-83ab-456820857b58 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:06.386925 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-04df2974-faab-4f8f-83ab-456820857b58 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:06.395321 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-04df2974-faab-4f8f-83ab-456820857b58 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:06.395860 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-04df2974-faab-4f8f-83ab-456820857b58 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:06.396894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-04df2974-faab-4f8f-83ab-456820857b58 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:06.397501 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-04df2974-faab-4f8f-83ab-456820857b58 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:06.621879 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-04df2974-faab-4f8f-83ab-456820857b58 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:06.630069 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-04df2974-faab-4f8f-83ab-456820857b58 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.251415 Jun 21 18:33:06.630661 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 211/409] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:06 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:06.944974 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:33:06.945570 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Tue Jun 21 18:33:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:33:07.654665 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-786174df-c878-48a0-a4c0-e0128080d2ca tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:07.655586 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-786174df-c878-48a0-a4c0-e0128080d2ca tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:07.666598 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-786174df-c878-48a0-a4c0-e0128080d2ca tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:07.667214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-786174df-c878-48a0-a4c0-e0128080d2ca tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:07.668340 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-786174df-c878-48a0-a4c0-e0128080d2ca tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:07.668872 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-786174df-c878-48a0-a4c0-e0128080d2ca tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:07.877854 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-786174df-c878-48a0-a4c0-e0128080d2ca tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:07.886765 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-786174df-c878-48a0-a4c0-e0128080d2ca tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.239471 Jun 21 18:33:07.887330 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 199/410] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:07 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:08.915431 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-158927d5-1c9f-47c4-85b1-21affe693c26 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:08.916456 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-158927d5-1c9f-47c4-85b1-21affe693c26 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:08.927157 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-158927d5-1c9f-47c4-85b1-21affe693c26 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:08.928095 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-158927d5-1c9f-47c4-85b1-21affe693c26 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:08.929587 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-158927d5-1c9f-47c4-85b1-21affe693c26 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:08.931655 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-158927d5-1c9f-47c4-85b1-21affe693c26 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:09.158163 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-158927d5-1c9f-47c4-85b1-21affe693c26 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:09.167686 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-158927d5-1c9f-47c4-85b1-21affe693c26 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.257368 Jun 21 18:33:09.169082 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 212/411] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:08 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:10.190924 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e30391d2-b0df-43b4-962d-95c6026bde4c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:10.191778 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e30391d2-b0df-43b4-962d-95c6026bde4c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:10.202780 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e30391d2-b0df-43b4-962d-95c6026bde4c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:10.203440 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e30391d2-b0df-43b4-962d-95c6026bde4c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:10.204817 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e30391d2-b0df-43b4-962d-95c6026bde4c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:10.205517 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e30391d2-b0df-43b4-962d-95c6026bde4c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:10.394784 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e30391d2-b0df-43b4-962d-95c6026bde4c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:10.406276 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e30391d2-b0df-43b4-962d-95c6026bde4c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.220176 Jun 21 18:33:10.407169 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 200/412] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:10 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:11.429132 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-98f9bd93-33bf-4bd1-a207-f2eadc8dcf1c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:11.430507 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-98f9bd93-33bf-4bd1-a207-f2eadc8dcf1c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:11.441070 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-98f9bd93-33bf-4bd1-a207-f2eadc8dcf1c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:11.441942 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-98f9bd93-33bf-4bd1-a207-f2eadc8dcf1c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:11.443335 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-98f9bd93-33bf-4bd1-a207-f2eadc8dcf1c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:11.443914 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-98f9bd93-33bf-4bd1-a207-f2eadc8dcf1c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:11.688554 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-98f9bd93-33bf-4bd1-a207-f2eadc8dcf1c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:11.703886 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-98f9bd93-33bf-4bd1-a207-f2eadc8dcf1c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.281508 Jun 21 18:33:11.706681 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 213/413] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:11 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:12.734890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-8d8113fa-2870-4b2c-9508-fcfcb9f4e68a tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:12.737007 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-8d8113fa-2870-4b2c-9508-fcfcb9f4e68a tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:12.749766 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8d8113fa-2870-4b2c-9508-fcfcb9f4e68a tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:12.750811 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8d8113fa-2870-4b2c-9508-fcfcb9f4e68a tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:12.752148 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8d8113fa-2870-4b2c-9508-fcfcb9f4e68a tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:12.752796 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8d8113fa-2870-4b2c-9508-fcfcb9f4e68a tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:12.990066 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-8d8113fa-2870-4b2c-9508-fcfcb9f4e68a tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:13.002221 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-8d8113fa-2870-4b2c-9508-fcfcb9f4e68a tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.274501 Jun 21 18:33:13.003249 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 201/414] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:12 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:14.028750 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c002a75d-2088-49fa-b553-6e4bbc0b7b28 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:14.029611 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c002a75d-2088-49fa-b553-6e4bbc0b7b28 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:14.037627 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c002a75d-2088-49fa-b553-6e4bbc0b7b28 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:14.038094 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c002a75d-2088-49fa-b553-6e4bbc0b7b28 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:14.038904 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c002a75d-2088-49fa-b553-6e4bbc0b7b28 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:14.039320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c002a75d-2088-49fa-b553-6e4bbc0b7b28 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:14.042935 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=100 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:14.202525 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c002a75d-2088-49fa-b553-6e4bbc0b7b28 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:14.211003 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c002a75d-2088-49fa-b553-6e4bbc0b7b28 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.186570 Jun 21 18:33:14.211829 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 214/415] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:14 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:15.231851 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5467bddf-f69e-413c-ad35-2cfc432569e2 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:15.232718 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-5467bddf-f69e-413c-ad35-2cfc432569e2 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:15.240370 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5467bddf-f69e-413c-ad35-2cfc432569e2 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:15.240895 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5467bddf-f69e-413c-ad35-2cfc432569e2 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:15.241790 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5467bddf-f69e-413c-ad35-2cfc432569e2 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:15.242431 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5467bddf-f69e-413c-ad35-2cfc432569e2 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:15.431236 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-5467bddf-f69e-413c-ad35-2cfc432569e2 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:15.441858 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-5467bddf-f69e-413c-ad35-2cfc432569e2 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.214111 Jun 21 18:33:15.442562 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 202/416] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:15 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:16.472194 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-fb41a6b9-4d12-49d7-b4f5-4bea53c9f444 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:16.472938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-fb41a6b9-4d12-49d7-b4f5-4bea53c9f444 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:16.481879 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fb41a6b9-4d12-49d7-b4f5-4bea53c9f444 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:16.482604 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fb41a6b9-4d12-49d7-b4f5-4bea53c9f444 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:16.483946 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fb41a6b9-4d12-49d7-b4f5-4bea53c9f444 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:16.484584 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fb41a6b9-4d12-49d7-b4f5-4bea53c9f444 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:16.684491 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-fb41a6b9-4d12-49d7-b4f5-4bea53c9f444 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:16.703124 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-fb41a6b9-4d12-49d7-b4f5-4bea53c9f444 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.244578 Jun 21 18:33:16.704140 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 215/417] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:16 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:17.729958 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c2a1827e-7951-4587-bd14-a910aebd51c3 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:17.733271 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c2a1827e-7951-4587-bd14-a910aebd51c3 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:17.750873 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c2a1827e-7951-4587-bd14-a910aebd51c3 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:17.752144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c2a1827e-7951-4587-bd14-a910aebd51c3 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:17.753919 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c2a1827e-7951-4587-bd14-a910aebd51c3 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:17.755025 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c2a1827e-7951-4587-bd14-a910aebd51c3 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:18.095929 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c2a1827e-7951-4587-bd14-a910aebd51c3 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:18.109823 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c2a1827e-7951-4587-bd14-a910aebd51c3 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.388533 Jun 21 18:33:18.125122 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 203/418] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:17 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:19.132159 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-54e47203-3c2b-4c1b-97a1-79d9649ba801 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:19.133046 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-54e47203-3c2b-4c1b-97a1-79d9649ba801 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:19.141667 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-54e47203-3c2b-4c1b-97a1-79d9649ba801 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:19.142179 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-54e47203-3c2b-4c1b-97a1-79d9649ba801 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:19.143022 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-54e47203-3c2b-4c1b-97a1-79d9649ba801 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:19.143636 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-54e47203-3c2b-4c1b-97a1-79d9649ba801 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:19.354643 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-54e47203-3c2b-4c1b-97a1-79d9649ba801 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:19.363934 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-54e47203-3c2b-4c1b-97a1-79d9649ba801 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.235954 Jun 21 18:33:19.364529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 216/419] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:19 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:20.402531 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-8200217b-f3ac-4152-82c4-c85131375f9d tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:20.453769 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-8200217b-f3ac-4152-82c4-c85131375f9d tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:20.477734 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8200217b-f3ac-4152-82c4-c85131375f9d tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:20.478995 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8200217b-f3ac-4152-82c4-c85131375f9d tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:20.480844 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8200217b-f3ac-4152-82c4-c85131375f9d tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:20.481874 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8200217b-f3ac-4152-82c4-c85131375f9d tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:20.869827 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-8200217b-f3ac-4152-82c4-c85131375f9d tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:20.891460 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-8200217b-f3ac-4152-82c4-c85131375f9d tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.507931 Jun 21 18:33:20.892743 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 204/420] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:20 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:22.049724 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e4a772ec-7546-4b15-860d-ee101dcb7a6d tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:22.051072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e4a772ec-7546-4b15-860d-ee101dcb7a6d tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:22.063308 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e4a772ec-7546-4b15-860d-ee101dcb7a6d tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:22.064130 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e4a772ec-7546-4b15-860d-ee101dcb7a6d tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:22.065741 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e4a772ec-7546-4b15-860d-ee101dcb7a6d tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:22.066597 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e4a772ec-7546-4b15-860d-ee101dcb7a6d tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:22.368847 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e4a772ec-7546-4b15-860d-ee101dcb7a6d tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:22.381515 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e4a772ec-7546-4b15-860d-ee101dcb7a6d tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.339824 Jun 21 18:33:22.382824 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 217/421] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:22 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:23.412289 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d74b2e18-f4fd-4db1-a95c-0c3125770a05 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:23.414268 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-d74b2e18-f4fd-4db1-a95c-0c3125770a05 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:23.418335 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=50 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:23.428898 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d74b2e18-f4fd-4db1-a95c-0c3125770a05 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:23.430312 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d74b2e18-f4fd-4db1-a95c-0c3125770a05 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:23.431364 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d74b2e18-f4fd-4db1-a95c-0c3125770a05 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:23.432659 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d74b2e18-f4fd-4db1-a95c-0c3125770a05 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:23.777525 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-d74b2e18-f4fd-4db1-a95c-0c3125770a05 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:23.825976 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-d74b2e18-f4fd-4db1-a95c-0c3125770a05 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.420614 Jun 21 18:33:23.846883 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 205/422] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:23 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:24.876400 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-52657f04-624a-4ff3-b322-246276ffac89 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:24.879452 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-52657f04-624a-4ff3-b322-246276ffac89 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:24.893465 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-52657f04-624a-4ff3-b322-246276ffac89 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:24.894402 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-52657f04-624a-4ff3-b322-246276ffac89 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:24.896159 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-52657f04-624a-4ff3-b322-246276ffac89 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:24.896987 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-52657f04-624a-4ff3-b322-246276ffac89 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:25.195788 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-52657f04-624a-4ff3-b322-246276ffac89 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:25.211626 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-52657f04-624a-4ff3-b322-246276ffac89 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.343179 Jun 21 18:33:25.230222 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 218/423] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:24 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:26.255758 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-28e5ef4b-19ee-4297-ae72-db79773aed78 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:26.256934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-28e5ef4b-19ee-4297-ae72-db79773aed78 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:26.269521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-28e5ef4b-19ee-4297-ae72-db79773aed78 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:26.271005 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-28e5ef4b-19ee-4297-ae72-db79773aed78 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:26.273721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-28e5ef4b-19ee-4297-ae72-db79773aed78 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:26.274780 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-28e5ef4b-19ee-4297-ae72-db79773aed78 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:26.578734 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-28e5ef4b-19ee-4297-ae72-db79773aed78 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:26.595863 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-28e5ef4b-19ee-4297-ae72-db79773aed78 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.348723 Jun 21 18:33:26.597073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 206/424] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:26 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:27.629365 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b398c2ef-537b-4fb1-9aed-1aaf33ab9703 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:27.631489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b398c2ef-537b-4fb1-9aed-1aaf33ab9703 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:27.643826 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b398c2ef-537b-4fb1-9aed-1aaf33ab9703 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:27.644660 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b398c2ef-537b-4fb1-9aed-1aaf33ab9703 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:27.646228 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b398c2ef-537b-4fb1-9aed-1aaf33ab9703 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:27.647203 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b398c2ef-537b-4fb1-9aed-1aaf33ab9703 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:27.903679 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b398c2ef-537b-4fb1-9aed-1aaf33ab9703 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:27.919085 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b398c2ef-537b-4fb1-9aed-1aaf33ab9703 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.298453 Jun 21 18:33:27.920984 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 219/425] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:27 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:28.948967 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c58b9a59-6f90-49e7-a65a-a28d2715e55e tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:28.950700 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c58b9a59-6f90-49e7-a65a-a28d2715e55e tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:28.970046 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c58b9a59-6f90-49e7-a65a-a28d2715e55e tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:28.970858 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c58b9a59-6f90-49e7-a65a-a28d2715e55e tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:28.972353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c58b9a59-6f90-49e7-a65a-a28d2715e55e tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:28.973714 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c58b9a59-6f90-49e7-a65a-a28d2715e55e tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:29.225749 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c58b9a59-6f90-49e7-a65a-a28d2715e55e tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:29.236924 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c58b9a59-6f90-49e7-a65a-a28d2715e55e tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.294878 Jun 21 18:33:29.237979 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 207/426] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:28 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:30.262728 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2992d056-0a24-4a93-a7c9-a4f1a179d922 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:30.264217 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-2992d056-0a24-4a93-a7c9-a4f1a179d922 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:30.269347 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=28 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:30.280271 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2992d056-0a24-4a93-a7c9-a4f1a179d922 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:30.281887 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2992d056-0a24-4a93-a7c9-a4f1a179d922 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:30.284013 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2992d056-0a24-4a93-a7c9-a4f1a179d922 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:30.284730 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2992d056-0a24-4a93-a7c9-a4f1a179d922 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:30.548325 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2992d056-0a24-4a93-a7c9-a4f1a179d922 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:30.566417 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-2992d056-0a24-4a93-a7c9-a4f1a179d922 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.310507 Jun 21 18:33:30.569774 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 220/427] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:30 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:33:31.587935 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-347b79f9-0a9e-47b4-aee3-642fc4e5a162 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:31.588558 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-347b79f9-0a9e-47b4-aee3-642fc4e5a162 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:31.597303 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-347b79f9-0a9e-47b4-aee3-642fc4e5a162 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:31.597794 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-347b79f9-0a9e-47b4-aee3-642fc4e5a162 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:31.598577 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-347b79f9-0a9e-47b4-aee3-642fc4e5a162 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:31.599364 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-347b79f9-0a9e-47b4-aee3-642fc4e5a162 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:31.824267 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-347b79f9-0a9e-47b4-aee3-642fc4e5a162 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:31.840304 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-347b79f9-0a9e-47b4-aee3-642fc4e5a162 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.256129 Jun 21 18:33:31.842434 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 208/428] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:31 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:32.871885 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8b0b995c-13f2-4bf8-bfef-797cd27c23c1 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:32.872766 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8b0b995c-13f2-4bf8-bfef-797cd27c23c1 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:32.887942 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8b0b995c-13f2-4bf8-bfef-797cd27c23c1 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:32.889411 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8b0b995c-13f2-4bf8-bfef-797cd27c23c1 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:32.893732 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8b0b995c-13f2-4bf8-bfef-797cd27c23c1 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:32.894627 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8b0b995c-13f2-4bf8-bfef-797cd27c23c1 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:33.140793 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-8b0b995c-13f2-4bf8-bfef-797cd27c23c1 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:33.158179 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8b0b995c-13f2-4bf8-bfef-797cd27c23c1 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.289857 Jun 21 18:33:33.159960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 221/429] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:32 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:34.078541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-a1c5fee5-749c-4e9e-bb1a-dd9848b17b1d req-793f88a2-bd9b-4b87-9f93-a2a98d2e687f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48898ad-34bd-484c-bc46-35060c0b0e58", "name": "network-vif-plugged", "status": "completed", "tag": "5b21b4b0-ce30-4b99-b116-75f298aa0fdf"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:34.089625 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-a1c5fee5-749c-4e9e-bb1a-dd9848b17b1d req-793f88a2-bd9b-4b87-9f93-a2a98d2e687f service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:34.090113 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-a1c5fee5-749c-4e9e-bb1a-dd9848b17b1d req-793f88a2-bd9b-4b87-9f93-a2a98d2e687f service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:34.100670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=73 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:34.154068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-a1c5fee5-749c-4e9e-bb1a-dd9848b17b1d req-793f88a2-bd9b-4b87-9f93-a2a98d2e687f service nova] Creating event network-vif-plugged:5b21b4b0-ce30-4b99-b116-75f298aa0fdf for instance d48898ad-34bd-484c-bc46-35060c0b0e58 on hv-cinder-84460 Jun 21 18:33:34.170577 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-a1c5fee5-749c-4e9e-bb1a-dd9848b17b1d req-793f88a2-bd9b-4b87-9f93-a2a98d2e687f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107412 Jun 21 18:33:34.173869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 209/430] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:33:34.181378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-7423b4af-07c9-4790-9a66-daf887243445 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:34.182498 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-7423b4af-07c9-4790-9a66-daf887243445 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:34.208038 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7423b4af-07c9-4790-9a66-daf887243445 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:34.209199 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7423b4af-07c9-4790-9a66-daf887243445 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:34.211302 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7423b4af-07c9-4790-9a66-daf887243445 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:34.212213 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7423b4af-07c9-4790-9a66-daf887243445 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:34.597665 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-7423b4af-07c9-4790-9a66-daf887243445 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:34.636131 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-7423b4af-07c9-4790-9a66-daf887243445 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.461614 Jun 21 18:33:34.636530 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 222/431] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:34 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:35.684416 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f75e9544-94f3-4f4d-be22-58edc4a9b3ce tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:35.688494 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f75e9544-94f3-4f4d-be22-58edc4a9b3ce tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:35.719172 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f75e9544-94f3-4f4d-be22-58edc4a9b3ce tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:35.720404 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f75e9544-94f3-4f4d-be22-58edc4a9b3ce tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:35.722147 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f75e9544-94f3-4f4d-be22-58edc4a9b3ce tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:35.723335 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f75e9544-94f3-4f4d-be22-58edc4a9b3ce tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:36.250482 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f75e9544-94f3-4f4d-be22-58edc4a9b3ce tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:36.279228 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f75e9544-94f3-4f4d-be22-58edc4a9b3ce tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.620892 Jun 21 18:33:36.281260 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 210/432] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:35 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:37.315094 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-fd541c3a-7f96-4cc1-b9eb-acf611ec46d2 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:37.323093 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-fd541c3a-7f96-4cc1-b9eb-acf611ec46d2 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:37.340212 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fd541c3a-7f96-4cc1-b9eb-acf611ec46d2 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:37.341895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fd541c3a-7f96-4cc1-b9eb-acf611ec46d2 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:37.343938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fd541c3a-7f96-4cc1-b9eb-acf611ec46d2 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:37.345236 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fd541c3a-7f96-4cc1-b9eb-acf611ec46d2 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:37.630116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-fd541c3a-7f96-4cc1-b9eb-acf611ec46d2 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:37.646792 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-fd541c3a-7f96-4cc1-b9eb-acf611ec46d2 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1315 microversion: 2.1 time: 0.352113 Jun 21 18:33:37.647446 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 223/433] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:37 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:38.663289 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-8d4084ef-83b6-451c-92fc-2b81dbdfc97b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:38.664346 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-8d4084ef-83b6-451c-92fc-2b81dbdfc97b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:38.677397 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8d4084ef-83b6-451c-92fc-2b81dbdfc97b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:38.678868 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8d4084ef-83b6-451c-92fc-2b81dbdfc97b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:38.680675 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8d4084ef-83b6-451c-92fc-2b81dbdfc97b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:38.681914 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8d4084ef-83b6-451c-92fc-2b81dbdfc97b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:38.690504 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-323e9aba-ef99-498d-9490-695445dc2133 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:38.692096 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-323e9aba-ef99-498d-9490-695445dc2133 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:38.731856 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-323e9aba-ef99-498d-9490-695445dc2133 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:38.736787 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-323e9aba-ef99-498d-9490-695445dc2133 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:38.743541 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-323e9aba-ef99-498d-9490-695445dc2133 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:38.745835 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-323e9aba-ef99-498d-9490-695445dc2133 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:39.084965 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.objects.instance [None req-8d4084ef-83b6-451c-92fc-2b81dbdfc97b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lazy-loading 'services' on Instance uuid 38292b40-45ba-4fe8-afa4-b0d3844b87c3 {{(pid=118108) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:33:39.250113 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-323e9aba-ef99-498d-9490-695445dc2133 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:39.276336 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-323e9aba-ef99-498d-9490-695445dc2133 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1465 microversion: 2.1 time: 0.601787 Jun 21 18:33:39.277792 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 224/434] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:38 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1465 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:39.396098 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1a07b7ce-9254-401c-8f45-5442f79b805f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:39.396971 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1a07b7ce-9254-401c-8f45-5442f79b805f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:39.428521 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1a07b7ce-9254-401c-8f45-5442f79b805f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:39.436870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1a07b7ce-9254-401c-8f45-5442f79b805f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:39.438698 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1a07b7ce-9254-401c-8f45-5442f79b805f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:39.439549 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1a07b7ce-9254-401c-8f45-5442f79b805f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:39.520851 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1a07b7ce-9254-401c-8f45-5442f79b805f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Going to try to terminate instance {{(pid=118109) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:33:39.602024 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-8d4084ef-83b6-451c-92fc-2b81dbdfc97b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "DELETE /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3/os-volume_attachments/83be0bf0-8245-444d-b864-96b7714bf805" status: 202 len: 0 microversion: 2.1 time: 0.943092 Jun 21 18:33:39.609688 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 211/435] 10.222.0.87 () {58 vars in 1415 bytes} [Tue Jun 21 18:33:38 2022] DELETE /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3/os-volume_attachments/83be0bf0-8245-444d-b864-96b7714bf805 => generated 0 bytes in 951 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:33:39.828231 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1a07b7ce-9254-401c-8f45-5442f79b805f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "DELETE /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 204 len: 0 microversion: 2.1 time: 0.439799 Jun 21 18:33:39.830623 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 225/436] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:33:39 2022] DELETE /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:33:39.853626 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a50474ab-8bc8-4699-8fa9-195e9d2ad62f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:39.854493 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-a50474ab-8bc8-4699-8fa9-195e9d2ad62f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:39.864845 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a50474ab-8bc8-4699-8fa9-195e9d2ad62f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:39.865278 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a50474ab-8bc8-4699-8fa9-195e9d2ad62f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:39.867169 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a50474ab-8bc8-4699-8fa9-195e9d2ad62f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:39.868055 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a50474ab-8bc8-4699-8fa9-195e9d2ad62f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:40.142485 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-a50474ab-8bc8-4699-8fa9-195e9d2ad62f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:40.176102 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a50474ab-8bc8-4699-8fa9-195e9d2ad62f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1471 microversion: 2.1 time: 0.334027 Jun 21 18:33:40.178214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 212/437] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:39 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1471 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:41.213899 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bf0c7626-9ff4-43bb-824e-2d3f87e2f2cf tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:41.215112 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-bf0c7626-9ff4-43bb-824e-2d3f87e2f2cf tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:41.227799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bf0c7626-9ff4-43bb-824e-2d3f87e2f2cf tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:41.228531 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bf0c7626-9ff4-43bb-824e-2d3f87e2f2cf tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:41.229980 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bf0c7626-9ff4-43bb-824e-2d3f87e2f2cf tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:41.230600 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bf0c7626-9ff4-43bb-824e-2d3f87e2f2cf tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:41.461092 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-bf0c7626-9ff4-43bb-824e-2d3f87e2f2cf tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:41.475951 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-bf0c7626-9ff4-43bb-824e-2d3f87e2f2cf tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1471 microversion: 2.1 time: 0.269882 Jun 21 18:33:41.476850 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 226/438] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:41 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:42.505174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f1e7ad61-7d21-4a65-8026-afef3fa8215c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:42.506966 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f1e7ad61-7d21-4a65-8026-afef3fa8215c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:42.519585 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f1e7ad61-7d21-4a65-8026-afef3fa8215c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:42.520356 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f1e7ad61-7d21-4a65-8026-afef3fa8215c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:42.521797 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f1e7ad61-7d21-4a65-8026-afef3fa8215c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:42.522916 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f1e7ad61-7d21-4a65-8026-afef3fa8215c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:42.751802 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f1e7ad61-7d21-4a65-8026-afef3fa8215c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:42.768712 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f1e7ad61-7d21-4a65-8026-afef3fa8215c tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1471 microversion: 2.1 time: 0.270343 Jun 21 18:33:42.770626 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 213/439] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:42 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1471 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:43.795710 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a77a0f9a-c90a-4717-891f-0b7dbefd61a3 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:43.796825 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-a77a0f9a-c90a-4717-891f-0b7dbefd61a3 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:43.804850 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a77a0f9a-c90a-4717-891f-0b7dbefd61a3 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:43.805306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a77a0f9a-c90a-4717-891f-0b7dbefd61a3 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:43.806130 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a77a0f9a-c90a-4717-891f-0b7dbefd61a3 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:43.806563 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a77a0f9a-c90a-4717-891f-0b7dbefd61a3 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:44.007655 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-a77a0f9a-c90a-4717-891f-0b7dbefd61a3 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:44.022043 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-a77a0f9a-c90a-4717-891f-0b7dbefd61a3 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1471 microversion: 2.1 time: 0.236297 Jun 21 18:33:44.023114 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 227/440] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:43 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1471 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:45.053784 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-587a8d34-be85-45fc-a64b-82035c35fc67 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:45.055734 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-587a8d34-be85-45fc-a64b-82035c35fc67 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:45.070558 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-587a8d34-be85-45fc-a64b-82035c35fc67 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:45.071220 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-587a8d34-be85-45fc-a64b-82035c35fc67 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:45.072483 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-587a8d34-be85-45fc-a64b-82035c35fc67 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:45.073124 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-587a8d34-be85-45fc-a64b-82035c35fc67 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:45.347525 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-587a8d34-be85-45fc-a64b-82035c35fc67 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:45.361353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-587a8d34-be85-45fc-a64b-82035c35fc67 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1471 microversion: 2.1 time: 0.316096 Jun 21 18:33:45.364374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 214/441] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:45 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1471 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:46.394023 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8b366bf6-815d-4dbc-b8b9-14321e19bc31 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:46.395312 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8b366bf6-815d-4dbc-b8b9-14321e19bc31 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:46.412149 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8b366bf6-815d-4dbc-b8b9-14321e19bc31 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:46.414017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8b366bf6-815d-4dbc-b8b9-14321e19bc31 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:46.416300 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8b366bf6-815d-4dbc-b8b9-14321e19bc31 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:46.417369 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8b366bf6-815d-4dbc-b8b9-14321e19bc31 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:46.423108 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:46.682805 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-8b366bf6-815d-4dbc-b8b9-14321e19bc31 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:46.697478 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8b366bf6-815d-4dbc-b8b9-14321e19bc31 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1471 microversion: 2.1 time: 0.308351 Jun 21 18:33:46.710918 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 228/442] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:46 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1471 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:33:47.731319 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6cdcc14d-9c67-46a3-8350-798c3bb03425 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:47.732490 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-6cdcc14d-9c67-46a3-8350-798c3bb03425 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:47.757868 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6cdcc14d-9c67-46a3-8350-798c3bb03425 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:47.758156 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6cdcc14d-9c67-46a3-8350-798c3bb03425 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:47.760050 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6cdcc14d-9c67-46a3-8350-798c3bb03425 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:47.760871 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6cdcc14d-9c67-46a3-8350-798c3bb03425 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:48.099105 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6cdcc14d-9c67-46a3-8350-798c3bb03425 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:48.116219 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6cdcc14d-9c67-46a3-8350-798c3bb03425 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1471 microversion: 2.1 time: 0.395526 Jun 21 18:33:48.118140 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 215/443] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:47 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1471 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:48.323366 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-26a07bc0-105e-45fe-ad69-97fcc38cdb8d req-d98c82a3-3d17-4589-8caa-b07211796441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d48898ad-34bd-484c-bc46-35060c0b0e58", "name": "network-vif-deleted", "tag": "5b21b4b0-ce30-4b99-b116-75f298aa0fdf"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:48.339437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-26a07bc0-105e-45fe-ad69-97fcc38cdb8d req-d98c82a3-3d17-4589-8caa-b07211796441 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:48.341109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-26a07bc0-105e-45fe-ad69-97fcc38cdb8d req-d98c82a3-3d17-4589-8caa-b07211796441 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:48.384952 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-26a07bc0-105e-45fe-ad69-97fcc38cdb8d req-d98c82a3-3d17-4589-8caa-b07211796441 service nova] Creating event network-vif-deleted:5b21b4b0-ce30-4b99-b116-75f298aa0fdf for instance d48898ad-34bd-484c-bc46-35060c0b0e58 on hv-cinder-84460 Jun 21 18:33:48.399797 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-26a07bc0-105e-45fe-ad69-97fcc38cdb8d req-d98c82a3-3d17-4589-8caa-b07211796441 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082207 Jun 21 18:33:48.403002 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 229/444] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:33:48.749276 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2e8bcb85-7507-44e7-845d-aa209016249b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:48.750482 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-2e8bcb85-7507-44e7-845d-aa209016249b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:48.763783 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e8bcb85-7507-44e7-845d-aa209016249b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:48.764650 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e8bcb85-7507-44e7-845d-aa209016249b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:48.766122 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e8bcb85-7507-44e7-845d-aa209016249b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:48.766972 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e8bcb85-7507-44e7-845d-aa209016249b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:48.830742 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-2e8bcb85-7507-44e7-845d-aa209016249b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Going to try to terminate instance {{(pid=118108) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:33:48.987976 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2e8bcb85-7507-44e7-845d-aa209016249b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "DELETE /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 204 len: 0 microversion: 2.1 time: 0.243674 Jun 21 18:33:48.991523 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 216/445] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:33:48 2022] DELETE /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:33:49.005747 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-317b1acd-f00b-42f0-824b-e859a07537fc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:49.008083 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-317b1acd-f00b-42f0-824b-e859a07537fc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:49.024369 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-317b1acd-f00b-42f0-824b-e859a07537fc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:49.025376 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-317b1acd-f00b-42f0-824b-e859a07537fc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:49.026848 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-317b1acd-f00b-42f0-824b-e859a07537fc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:49.027686 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-317b1acd-f00b-42f0-824b-e859a07537fc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:49.145413 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-fcbead4f-2645-421d-89fa-bcfca833ade7 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:49.146893 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-fcbead4f-2645-421d-89fa-bcfca833ade7 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:49.158370 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fcbead4f-2645-421d-89fa-bcfca833ade7 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:49.159159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fcbead4f-2645-421d-89fa-bcfca833ade7 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:49.160594 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fcbead4f-2645-421d-89fa-bcfca833ade7 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:49.161376 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fcbead4f-2645-421d-89fa-bcfca833ade7 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:49.229387 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fcbead4f-2645-421d-89fa-bcfca833ade7 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:49.230549 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fcbead4f-2645-421d-89fa-bcfca833ade7 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:49.231010 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.objects.instance [None req-fcbead4f-2645-421d-89fa-bcfca833ade7 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lazy-loading 'fault' on Instance uuid d48898ad-34bd-484c-bc46-35060c0b0e58 {{(pid=118108) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:33:49.388326 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-fcbead4f-2645-421d-89fa-bcfca833ade7 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:49.404779 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-fcbead4f-2645-421d-89fa-bcfca833ade7 tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1305 microversion: 2.1 time: 0.267215 Jun 21 18:33:49.405826 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 217/446] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:49 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1305 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:33:49.451626 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-317b1acd-f00b-42f0-824b-e859a07537fc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:49.461552 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-317b1acd-f00b-42f0-824b-e859a07537fc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1513 microversion: 2.1 time: 0.465518 Jun 21 18:33:49.475029 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 230/447] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:48 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1513 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:50.444250 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-af116e92-363f-42d6-8991-11fd203b043f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:50.445448 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-af116e92-363f-42d6-8991-11fd203b043f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:50.457996 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-af116e92-363f-42d6-8991-11fd203b043f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:50.458917 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-af116e92-363f-42d6-8991-11fd203b043f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:50.460688 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-af116e92-363f-42d6-8991-11fd203b043f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:50.461567 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-af116e92-363f-42d6-8991-11fd203b043f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:50.490924 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-078e1ced-41d7-4899-bfd2-5c41912a24a0 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:50.493151 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-078e1ced-41d7-4899-bfd2-5c41912a24a0 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:50.532783 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-078e1ced-41d7-4899-bfd2-5c41912a24a0 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:50.533545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-078e1ced-41d7-4899-bfd2-5c41912a24a0 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:50.536564 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-078e1ced-41d7-4899-bfd2-5c41912a24a0 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:50.537933 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-078e1ced-41d7-4899-bfd2-5c41912a24a0 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:50.560576 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-af116e92-363f-42d6-8991-11fd203b043f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:50.561140 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-af116e92-363f-42d6-8991-11fd203b043f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:50.561965 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.objects.instance [None req-af116e92-363f-42d6-8991-11fd203b043f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lazy-loading 'fault' on Instance uuid d48898ad-34bd-484c-bc46-35060c0b0e58 {{(pid=118108) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:33:50.709128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-af116e92-363f-42d6-8991-11fd203b043f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bbfa51f793c4d2fb53ce386f4d33192', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5569463610e44dc82d15553cbbcb02c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:50.725449 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-af116e92-363f-42d6-8991-11fd203b043f tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 200 len: 1305 microversion: 2.1 time: 0.296052 Jun 21 18:33:50.727347 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 218/448] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:50 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 1305 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:50.840758 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-078e1ced-41d7-4899-bfd2-5c41912a24a0 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:50.854616 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-078e1ced-41d7-4899-bfd2-5c41912a24a0 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1513 microversion: 2.1 time: 0.371912 Jun 21 18:33:50.855491 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 231/449] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:50 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1513 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:51.759090 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-31ec7a6f-291d-4932-aa1d-b0206011e21e tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:51.759903 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-31ec7a6f-291d-4932-aa1d-b0206011e21e tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] [instance: d48898ad-34bd-484c-bc46-35060c0b0e58] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:51.773390 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-31ec7a6f-291d-4932-aa1d-b0206011e21e tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:51.774116 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-31ec7a6f-291d-4932-aa1d-b0206011e21e tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:51.775286 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-31ec7a6f-291d-4932-aa1d-b0206011e21e tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:51.776056 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-31ec7a6f-291d-4932-aa1d-b0206011e21e tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:51.796789 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-31ec7a6f-291d-4932-aa1d-b0206011e21e tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] HTTP exception thrown: Instance d48898ad-34bd-484c-bc46-35060c0b0e58 could not be found. Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-31ec7a6f-291d-4932-aa1d-b0206011e21e tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Request method failure captured: Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 HTTP/1.1 Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABisg67hhdxyDSNowM4F2usHFXe0ZD2kEe653cEEhUJGgZvkTi3KApS7A0rXezOMhcNKE8RIFMz5RuKkfsVqZiMQ7DXYyC-ekC0N7FNyo3yWIFJcyD2RXCGYkMJdhDFc1ETqKomvBvu5fdy7BEVYnk4q0-1abBI6zU1gyC99bNRjHhDCi0 Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: b5569463610e44dc82d15553cbbcb02c Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-VolumesNegativeTest-785824616 Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:33:51.801438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:33:51.804682 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b5569463610e44dc82d15553cbbcb02c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b5569463610e44dc82d15553cbbcb02c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b5569463610e44dc82d15553cbbcb02c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b5569463610e44dc82d15553cbbcb02c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:33:51.804682 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-VolumesNegativeTest-785824616 Jun 21 18:33:51.804682 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: b5569463610e44dc82d15553cbbcb02c Jun 21 18:33:51.804682 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-VolumesNegativeTest-785824616 Jun 21 18:33:51.804682 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-VolumesNegativeTest-785824616-project Jun 21 18:33:51.804682 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:33:51.804682 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:33:51.804682 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 2bbfa51f793c4d2fb53ce386f4d33192 Jun 21 18:33:51.804682 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-VolumesNegativeTest-785824616-project Jun 21 18:33:51.804682 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:33:51.804682 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance d48898ad-34bd-484c-bc46-35060c0b0e58 could not be found. Jun 21 18:33:51.804682 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': 'd48898ad-34bd-484c-bc46-35060c0b0e58'} Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d48898ad-34bd-484c-bc46-35060c0b0e58 could not be found. Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:33:51.807353 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:33:51.812862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:33:51.812862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:33:51.812862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:33:51.812862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:33:51.812862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:33:51.812862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:33:51.812862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:33:51.812862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d48898ad-34bd-484c-bc46-35060c0b0e58 could not be found. Jun 21 18:33:51.812862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:33:51.812862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:51.812862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:33:51.812862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:51.812862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:51.812862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:51.812862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:33:51.812862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:33:51.812862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d48898ad-34bd-484c-bc46-35060c0b0e58 could not be found. Jun 21 18:33:51.812862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:33:51.815479 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-31ec7a6f-291d-4932-aa1d-b0206011e21e tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] Returning 404 to user: Instance d48898ad-34bd-484c-bc46-35060c0b0e58 could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:33:51.815479 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-31ec7a6f-291d-4932-aa1d-b0206011e21e tempest-VolumesNegativeTest-785824616 tempest-VolumesNegativeTest-785824616-project] 10.222.0.87 "GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58" status: 404 len: 111 microversion: 2.1 time: 0.052609 Jun 21 18:33:51.815479 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 219/450] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:51 2022] GET /compute/v2.1/servers/d48898ad-34bd-484c-bc46-35060c0b0e58 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:33:51.894650 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-36c5aba0-f61e-4770-af09-17400a16f620 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:51.896953 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-36c5aba0-f61e-4770-af09-17400a16f620 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:51.909968 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-36c5aba0-f61e-4770-af09-17400a16f620 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:51.911298 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-36c5aba0-f61e-4770-af09-17400a16f620 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:51.913341 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-36c5aba0-f61e-4770-af09-17400a16f620 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:51.914256 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-36c5aba0-f61e-4770-af09-17400a16f620 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:52.339761 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-36c5aba0-f61e-4770-af09-17400a16f620 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:52.355382 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-36c5aba0-f61e-4770-af09-17400a16f620 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1513 microversion: 2.1 time: 0.478016 Jun 21 18:33:52.370498 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 232/451] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:51 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1513 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:52.827178 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-729acf8c-c2b6-45fe-a2a3-9b4e3a914fac req-3f39128d-8b03-4a2d-955a-c2c8d64815f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38292b40-45ba-4fe8-afa4-b0d3844b87c3", "name": "network-vif-deleted", "tag": "0945feb3-aa60-4570-a771-8886a7667bfc"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:33:52.861792 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-729acf8c-c2b6-45fe-a2a3-9b4e3a914fac req-3f39128d-8b03-4a2d-955a-c2c8d64815f6 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:52.862585 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-729acf8c-c2b6-45fe-a2a3-9b4e3a914fac req-3f39128d-8b03-4a2d-955a-c2c8d64815f6 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:52.900819 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-729acf8c-c2b6-45fe-a2a3-9b4e3a914fac req-3f39128d-8b03-4a2d-955a-c2c8d64815f6 service nova] Creating event network-vif-deleted:0945feb3-aa60-4570-a771-8886a7667bfc for instance 38292b40-45ba-4fe8-afa4-b0d3844b87c3 on hv-cinder-84460 Jun 21 18:33:52.932893 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-729acf8c-c2b6-45fe-a2a3-9b4e3a914fac req-3f39128d-8b03-4a2d-955a-c2c8d64815f6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122138 Jun 21 18:33:52.937758 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 220/452] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:33:53.384088 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-7517025d-f6f5-4278-b9e9-5aea0176a7e3 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:53.385111 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-7517025d-f6f5-4278-b9e9-5aea0176a7e3 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:53.398192 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7517025d-f6f5-4278-b9e9-5aea0176a7e3 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:53.398938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7517025d-f6f5-4278-b9e9-5aea0176a7e3 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:53.400202 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7517025d-f6f5-4278-b9e9-5aea0176a7e3 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:53.400943 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7517025d-f6f5-4278-b9e9-5aea0176a7e3 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:53.448122 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7517025d-f6f5-4278-b9e9-5aea0176a7e3 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:53.461945 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7517025d-f6f5-4278-b9e9-5aea0176a7e3 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:53.461945 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.objects.instance [None req-7517025d-f6f5-4278-b9e9-5aea0176a7e3 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lazy-loading 'fault' on Instance uuid 38292b40-45ba-4fe8-afa4-b0d3844b87c3 {{(pid=118109) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:33:53.530906 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-7517025d-f6f5-4278-b9e9-5aea0176a7e3 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:33:53.550318 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-7517025d-f6f5-4278-b9e9-5aea0176a7e3 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 200 len: 1308 microversion: 2.1 time: 0.172643 Jun 21 18:33:53.551135 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 233/453] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:53 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:33:54.575741 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-1a9da41e-8a71-4131-9d9c-621f053e00f0 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:33:54.576887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-1a9da41e-8a71-4131-9d9c-621f053e00f0 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: 38292b40-45ba-4fe8-afa4-b0d3844b87c3] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:33:54.579739 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:33:54.589766 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1a9da41e-8a71-4131-9d9c-621f053e00f0 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:54.590291 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1a9da41e-8a71-4131-9d9c-621f053e00f0 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:54.591338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1a9da41e-8a71-4131-9d9c-621f053e00f0 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:33:54.591977 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1a9da41e-8a71-4131-9d9c-621f053e00f0 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:33:54.623767 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-1a9da41e-8a71-4131-9d9c-621f053e00f0 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] HTTP exception thrown: Instance 38292b40-45ba-4fe8-afa4-b0d3844b87c3 could not be found. Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-1a9da41e-8a71-4131-9d9c-621f053e00f0 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Request method failure captured: Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 HTTP/1.1 Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABisg5xx-haiQAHmNsYeom5G3Ju1RvpdC4RxiNK-2Hvjcd5DS4--G6sc_QjSn7h728NVPV3AoavJR7DIQ6gXMkRoyVKnqTrLW310gxw20Vk7Wmpc1F65lwk99Ey539Iuc8eRcAZeP-fWRSQW3iNup07V41Nc0j46kWS7OcGcMuinKUgS20 Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 55c4efeea2f54994b6f45b5cc346c43b Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-VolumesSnapshotTestJSON-408844021 Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:33:54.627608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:33:54.630042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/55c4efeea2f54994b6f45b5cc346c43b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/55c4efeea2f54994b6f45b5cc346c43b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/55c4efeea2f54994b6f45b5cc346c43b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_55c4efeea2f54994b6f45b5cc346c43b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:33:54.630042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-VolumesSnapshotTestJSON-408844021 Jun 21 18:33:54.630042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 55c4efeea2f54994b6f45b5cc346c43b Jun 21 18:33:54.630042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-408844021 Jun 21 18:33:54.630042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-VolumesSnapshotTestJSON-408844021-project Jun 21 18:33:54.630042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:33:54.630042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:33:54.630042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: ec179985fc3b41d188ca69d9e03263d0 Jun 21 18:33:54.630042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-VolumesSnapshotTestJSON-408844021-project Jun 21 18:33:54.630042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:33:54.630042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance 38292b40-45ba-4fe8-afa4-b0d3844b87c3 could not be found. Jun 21 18:33:54.630042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': '38292b40-45ba-4fe8-afa4-b0d3844b87c3'} Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38292b40-45ba-4fe8-afa4-b0d3844b87c3 could not be found. Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:33:54.632487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:33:54.634828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:33:54.634828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:33:54.634828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:33:54.634828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:33:54.634828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:33:54.634828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:33:54.634828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:33:54.634828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38292b40-45ba-4fe8-afa4-b0d3844b87c3 could not be found. Jun 21 18:33:54.634828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:33:54.634828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:33:54.634828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:33:54.634828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:33:54.634828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:33:54.634828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:33:54.634828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:33:54.634828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:33:54.634828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38292b40-45ba-4fe8-afa4-b0d3844b87c3 could not be found. Jun 21 18:33:54.634828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:33:54.641228 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-1a9da41e-8a71-4131-9d9c-621f053e00f0 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Returning 404 to user: Instance 38292b40-45ba-4fe8-afa4-b0d3844b87c3 could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:33:54.641228 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-1a9da41e-8a71-4131-9d9c-621f053e00f0 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3" status: 404 len: 111 microversion: 2.1 time: 0.060505 Jun 21 18:33:54.641228 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 221/454] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:33:54 2022] GET /compute/v2.1/servers/38292b40-45ba-4fe8-afa4-b0d3844b87c3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:34:03.920179 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-272253ad-2c82-4f5d-80b2-4c23fb3fc589 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:03.922570 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-272253ad-2c82-4f5d-80b2-4c23fb3fc589 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:03.930568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:03.933022 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=33 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:03.945456 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-272253ad-2c82-4f5d-80b2-4c23fb3fc589 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:03.946996 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-272253ad-2c82-4f5d-80b2-4c23fb3fc589 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:03.948910 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-272253ad-2c82-4f5d-80b2-4c23fb3fc589 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:03.950171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-272253ad-2c82-4f5d-80b2-4c23fb3fc589 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:04.000969 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-272253ad-2c82-4f5d-80b2-4c23fb3fc589 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4/ips" status: 200 len: 148 microversion: 2.1 time: 0.089262 Jun 21 18:34:04.019406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 234/455] 10.222.0.87 () {58 vars in 1247 bytes} [Tue Jun 21 18:34:03 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4/ips => generated 148 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:09.147405 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-57df46aa-d4a2-488b-a179-4b2ab6a0e180 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:09.148419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-57df46aa-d4a2-488b-a179-4b2ab6a0e180 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:09.152453 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:09.153520 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:09.162609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-57df46aa-d4a2-488b-a179-4b2ab6a0e180 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:09.163040 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-57df46aa-d4a2-488b-a179-4b2ab6a0e180 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:09.164018 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-57df46aa-d4a2-488b-a179-4b2ab6a0e180 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:09.164885 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-57df46aa-d4a2-488b-a179-4b2ab6a0e180 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:09.210623 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-57df46aa-d4a2-488b-a179-4b2ab6a0e180 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e/ips" status: 200 len: 145 microversion: 2.1 time: 0.070853 Jun 21 18:34:09.211646 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 222/456] 10.222.0.87 () {58 vars in 1247 bytes} [Tue Jun 21 18:34:09 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e/ips => generated 145 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:09.579395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c40d1355-8d17-43c7-8a1d-5bcd419187dc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-881628165", "imageRef": "c28659fb-c2d3-4dda-a330-1323a974987e", "flavorRef": "452", "networks": [{"uuid": "38a1b177-7269-4848-b0d6-5aa065bd4bbf"}]}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:09.665273 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.network.neutron [None req-c40d1355-8d17-43c7-8a1d-5bcd419187dc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] validate_networks() for [('38a1b177-7269-4848-b0d6-5aa065bd4bbf', None, None, None, None, None)] {{(pid=118109) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:34:10.096921 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-eb6ac3fc-c13b-4fd8-b39b-da7b50918346 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10d651db-19fe-4ee4-bcc9-343480b202c5"}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:10.101199 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-eb6ac3fc-c13b-4fd8-b39b-da7b50918346 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:10.115280 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eb6ac3fc-c13b-4fd8-b39b-da7b50918346 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:10.116212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eb6ac3fc-c13b-4fd8-b39b-da7b50918346 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:10.118835 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eb6ac3fc-c13b-4fd8-b39b-da7b50918346 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:10.119686 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eb6ac3fc-c13b-4fd8-b39b-da7b50918346 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:10.356368 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-c40d1355-8d17-43c7-8a1d-5bcd419187dc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Flavor limits 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:34:10.357231 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-c40d1355-8d17-43c7-8a1d-5bcd419187dc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Image limits 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:34:10.358109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-c40d1355-8d17-43c7-8a1d-5bcd419187dc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Flavor pref 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:34:10.358640 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-c40d1355-8d17-43c7-8a1d-5bcd419187dc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Image pref 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:34:10.359338 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-c40d1355-8d17-43c7-8a1d-5bcd419187dc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:34:10.378793 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c40d1355-8d17-43c7-8a1d-5bcd419187dc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:10.379639 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c40d1355-8d17-43c7-8a1d-5bcd419187dc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:10.381360 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c40d1355-8d17-43c7-8a1d-5bcd419187dc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:10.382248 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c40d1355-8d17-43c7-8a1d-5bcd419187dc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:10.414961 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-c40d1355-8d17-43c7-8a1d-5bcd419187dc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Getting quotas for project 55c4efeea2f54994b6f45b5cc346c43b. Resources: {'instances', 'ram', 'cores'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:34:10.423657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-c40d1355-8d17-43c7-8a1d-5bcd419187dc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Getting quotas for user ec179985fc3b41d188ca69d9e03263d0 and project 55c4efeea2f54994b6f45b5cc346c43b. Resources: {'instances', 'ram', 'cores'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:34:10.446490 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c40d1355-8d17-43c7-8a1d-5bcd419187dc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Going to run 1 instances... {{(pid=118109) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:34:10.450604 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c40d1355-8d17-43c7-8a1d-5bcd419187dc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c28659fb-c2d3-4dda-a330-1323a974987e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118109) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:34:10.544057 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c40d1355-8d17-43c7-8a1d-5bcd419187dc tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.971467 Jun 21 18:34:10.546196 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 235/457] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:34:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:34:10.570516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-cd4c0db5-a2fa-4ac9-9593-8734dab38618 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:10.572071 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-cd4c0db5-a2fa-4ac9-9593-8734dab38618 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:10.689989 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-cd4c0db5-a2fa-4ac9-9593-8734dab38618 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:10.699127 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-cd4c0db5-a2fa-4ac9-9593-8734dab38618 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c" status: 200 len: 1218 microversion: 2.1 time: 0.140344 Jun 21 18:34:10.699743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 236/458] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:10 2022] GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c => generated 1218 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:10.735396 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-eb6ac3fc-c13b-4fd8-b39b-da7b50918346 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "POST /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.647096 Jun 21 18:34:10.736506 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 223/459] 10.222.0.87 () {60 vars in 1322 bytes} [Tue Jun 21 18:34:10 2022] POST /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4/os-volume_attachments => generated 194 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:11.729958 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-01b6678b-20ca-4fcc-904a-d8691f6e1f4e tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:11.730787 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-01b6678b-20ca-4fcc-904a-d8691f6e1f4e tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:11.742785 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-01b6678b-20ca-4fcc-904a-d8691f6e1f4e tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:11.743679 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-01b6678b-20ca-4fcc-904a-d8691f6e1f4e tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:11.745110 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-01b6678b-20ca-4fcc-904a-d8691f6e1f4e tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:11.745957 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-01b6678b-20ca-4fcc-904a-d8691f6e1f4e tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:11.863989 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-01b6678b-20ca-4fcc-904a-d8691f6e1f4e tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:11.877098 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-01b6678b-20ca-4fcc-904a-d8691f6e1f4e tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c" status: 200 len: 1270 microversion: 2.1 time: 0.153110 Jun 21 18:34:11.883137 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 237/460] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:11 2022] GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:12.905390 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6ac60d13-bb75-4b24-a1bd-33e15cdc3a36 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:12.906423 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-6ac60d13-bb75-4b24-a1bd-33e15cdc3a36 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:12.911720 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8dd31be3-bc74-4df6-828d-b0a9495479e6 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09ddef93-4298-4613-bb94-eacadf0a6d9d"}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:12.913155 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8dd31be3-bc74-4df6-828d-b0a9495479e6 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:12.917462 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6ac60d13-bb75-4b24-a1bd-33e15cdc3a36 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:12.918334 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6ac60d13-bb75-4b24-a1bd-33e15cdc3a36 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:12.919479 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6ac60d13-bb75-4b24-a1bd-33e15cdc3a36 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:12.920020 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6ac60d13-bb75-4b24-a1bd-33e15cdc3a36 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:12.924601 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8dd31be3-bc74-4df6-828d-b0a9495479e6 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:12.925540 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8dd31be3-bc74-4df6-828d-b0a9495479e6 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:12.926493 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8dd31be3-bc74-4df6-828d-b0a9495479e6 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:12.927325 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8dd31be3-bc74-4df6-828d-b0a9495479e6 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:13.430832 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8dd31be3-bc74-4df6-828d-b0a9495479e6 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "POST /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.524719 Jun 21 18:34:13.432122 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 238/461] 10.222.0.87 () {60 vars in 1322 bytes} [Tue Jun 21 18:34:12 2022] POST /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e/os-volume_attachments => generated 194 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:34:13.466982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6ac60d13-bb75-4b24-a1bd-33e15cdc3a36 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:13.477244 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6ac60d13-bb75-4b24-a1bd-33e15cdc3a36 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c" status: 200 len: 1318 microversion: 2.1 time: 0.577977 Jun 21 18:34:13.478202 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 224/462] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:12 2022] GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c => generated 1318 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:14.313957 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-f7daf4df-c44f-4d62-b615-c0c24c6c6769 req-e0937939-57f7-41cc-b5bf-e3e33fe28c7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab23aada-50d7-4852-9624-751aaf33ea8c", "tag": "1c6785aa-db33-4621-a2f7-f66bb1b814e9"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:14.331702 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-f7daf4df-c44f-4d62-b615-c0c24c6c6769 req-e0937939-57f7-41cc-b5bf-e3e33fe28c7a service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:14.332863 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-f7daf4df-c44f-4d62-b615-c0c24c6c6769 req-e0937939-57f7-41cc-b5bf-e3e33fe28c7a service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:14.350882 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-f7daf4df-c44f-4d62-b615-c0c24c6c6769 req-e0937939-57f7-41cc-b5bf-e3e33fe28c7a service nova] Creating event network-changed:1c6785aa-db33-4621-a2f7-f66bb1b814e9 for instance ab23aada-50d7-4852-9624-751aaf33ea8c on hv-cinder-84460 Jun 21 18:34:14.358099 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-f7daf4df-c44f-4d62-b615-c0c24c6c6769 req-e0937939-57f7-41cc-b5bf-e3e33fe28c7a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055744 Jun 21 18:34:14.359509 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 239/463] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:14.499554 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-1d19a612-457e-4e3e-8545-32ad96e13469 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:14.500635 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-1d19a612-457e-4e3e-8545-32ad96e13469 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:14.509507 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1d19a612-457e-4e3e-8545-32ad96e13469 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:14.510077 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1d19a612-457e-4e3e-8545-32ad96e13469 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:14.510884 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1d19a612-457e-4e3e-8545-32ad96e13469 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:14.511316 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1d19a612-457e-4e3e-8545-32ad96e13469 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:14.720160 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-1d19a612-457e-4e3e-8545-32ad96e13469 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:14.729116 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-1d19a612-457e-4e3e-8545-32ad96e13469 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c" status: 200 len: 1318 microversion: 2.1 time: 0.233807 Jun 21 18:34:14.730002 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 225/464] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:14 2022] GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:15.748742 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a90a4c73-5373-4fc3-a0e1-0cd332359914 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:15.749481 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-a90a4c73-5373-4fc3-a0e1-0cd332359914 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:15.757516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a90a4c73-5373-4fc3-a0e1-0cd332359914 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:15.758333 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a90a4c73-5373-4fc3-a0e1-0cd332359914 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:15.759363 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a90a4c73-5373-4fc3-a0e1-0cd332359914 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:15.760031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a90a4c73-5373-4fc3-a0e1-0cd332359914 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:16.021349 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-a90a4c73-5373-4fc3-a0e1-0cd332359914 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:16.029802 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-a90a4c73-5373-4fc3-a0e1-0cd332359914 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c" status: 200 len: 1318 microversion: 2.1 time: 0.286008 Jun 21 18:34:16.030393 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 240/465] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:15 2022] GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:17.056422 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-08b6ecc3-3035-442a-bd01-299e2e88559b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:17.057615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-08b6ecc3-3035-442a-bd01-299e2e88559b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:17.070197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-08b6ecc3-3035-442a-bd01-299e2e88559b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:17.071161 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-08b6ecc3-3035-442a-bd01-299e2e88559b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:17.072557 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-08b6ecc3-3035-442a-bd01-299e2e88559b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:17.073221 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-08b6ecc3-3035-442a-bd01-299e2e88559b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:17.305709 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-08b6ecc3-3035-442a-bd01-299e2e88559b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:17.319622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-08b6ecc3-3035-442a-bd01-299e2e88559b tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c" status: 200 len: 1318 microversion: 2.1 time: 0.270345 Jun 21 18:34:17.320610 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 226/466] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:17 2022] GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:18.342534 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c340b06f-8859-4ea0-8f61-e53a85fe92c4 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:18.343630 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c340b06f-8859-4ea0-8f61-e53a85fe92c4 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:18.356187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c340b06f-8859-4ea0-8f61-e53a85fe92c4 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:18.356969 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c340b06f-8859-4ea0-8f61-e53a85fe92c4 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:18.358490 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c340b06f-8859-4ea0-8f61-e53a85fe92c4 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:18.359219 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c340b06f-8859-4ea0-8f61-e53a85fe92c4 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:18.624490 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c340b06f-8859-4ea0-8f61-e53a85fe92c4 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:18.656338 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c340b06f-8859-4ea0-8f61-e53a85fe92c4 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c" status: 200 len: 1318 microversion: 2.1 time: 0.320337 Jun 21 18:34:18.661393 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 241/467] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:18 2022] GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:19.685552 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f732e830-6699-4e68-8154-2388559aa118 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:19.687935 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f732e830-6699-4e68-8154-2388559aa118 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:19.700188 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f732e830-6699-4e68-8154-2388559aa118 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:19.701252 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f732e830-6699-4e68-8154-2388559aa118 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:19.702909 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f732e830-6699-4e68-8154-2388559aa118 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:19.704346 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f732e830-6699-4e68-8154-2388559aa118 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:19.946450 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f732e830-6699-4e68-8154-2388559aa118 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:19.960893 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f732e830-6699-4e68-8154-2388559aa118 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c" status: 200 len: 1318 microversion: 2.1 time: 0.285003 Jun 21 18:34:19.964202 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 227/468] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:19 2022] GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:20.990044 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-af3d787a-58ee-4fe8-9c4b-c8b6747c4717 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:20.990949 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-af3d787a-58ee-4fe8-9c4b-c8b6747c4717 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:20.994255 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=2 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:20.995685 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=8 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:21.006679 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-af3d787a-58ee-4fe8-9c4b-c8b6747c4717 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:21.007215 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-af3d787a-58ee-4fe8-9c4b-c8b6747c4717 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:21.008083 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-af3d787a-58ee-4fe8-9c4b-c8b6747c4717 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:21.008660 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-af3d787a-58ee-4fe8-9c4b-c8b6747c4717 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:21.284664 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-af3d787a-58ee-4fe8-9c4b-c8b6747c4717 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:21.300607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-af3d787a-58ee-4fe8-9c4b-c8b6747c4717 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c" status: 200 len: 1318 microversion: 2.1 time: 0.315561 Jun 21 18:34:21.302172 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 242/469] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:20 2022] GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:22.329890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-812bfad0-b091-4d38-83ba-054e6ed53019 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:22.331726 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-812bfad0-b091-4d38-83ba-054e6ed53019 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:22.347132 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-812bfad0-b091-4d38-83ba-054e6ed53019 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:22.348401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-812bfad0-b091-4d38-83ba-054e6ed53019 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:22.350329 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-812bfad0-b091-4d38-83ba-054e6ed53019 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:22.350994 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-812bfad0-b091-4d38-83ba-054e6ed53019 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:22.628551 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-812bfad0-b091-4d38-83ba-054e6ed53019 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:22.643674 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-812bfad0-b091-4d38-83ba-054e6ed53019 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c" status: 200 len: 1318 microversion: 2.1 time: 0.322518 Jun 21 18:34:22.650629 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 228/470] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:22 2022] GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:22.738253 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-87eb7553-6334-429d-bdec-3d665408c2fb req-983e0658-1150-4394-975f-dfbf0d5f7555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab23aada-50d7-4852-9624-751aaf33ea8c", "name": "network-vif-plugged", "status": "completed", "tag": "1c6785aa-db33-4621-a2f7-f66bb1b814e9"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:22.755903 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-87eb7553-6334-429d-bdec-3d665408c2fb req-983e0658-1150-4394-975f-dfbf0d5f7555 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:22.757029 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-87eb7553-6334-429d-bdec-3d665408c2fb req-983e0658-1150-4394-975f-dfbf0d5f7555 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:22.791933 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-87eb7553-6334-429d-bdec-3d665408c2fb req-983e0658-1150-4394-975f-dfbf0d5f7555 service nova] Creating event network-vif-plugged:1c6785aa-db33-4621-a2f7-f66bb1b814e9 for instance ab23aada-50d7-4852-9624-751aaf33ea8c on hv-cinder-84460 Jun 21 18:34:22.802441 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-87eb7553-6334-429d-bdec-3d665408c2fb req-983e0658-1150-4394-975f-dfbf0d5f7555 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071562 Jun 21 18:34:22.803527 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 243/471] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:23.152493 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-ba2c451e-1820-4187-bd60-5e08bf511d2a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Action: 'create', calling method: .version_select at 0x7fd8b80a61f0>, body: {"keypair": {"name": "tempest-keypair-1520450228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMG1pLPxXeRP5RCOfMxJ5Fcslw8pfCJnDPj7Bo2TPUsGAql0Ur5U8QWZYYNnXyN7gS7CYlwT36DLP1xQI2f2k6wW+dlkpBcxChavJuqwopWDrpPYtda2my3abHpcln0h0g=="}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:23.180512 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-ba2c451e-1820-4187-bd60-5e08bf511d2a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Getting quotas for project 53e2bb9f793041c2aef6e222b76c3961. Resources: {'key_pairs'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:34:23.189774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-ba2c451e-1820-4187-bd60-5e08bf511d2a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Getting quotas for user 144c9c31ed9b469aa200dcb16c89ab4e and project 53e2bb9f793041c2aef6e222b76c3961. Resources: {'key_pairs'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:34:23.243683 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-ba2c451e-1820-4187-bd60-5e08bf511d2a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.100550 Jun 21 18:34:23.244934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 229/472] 10.222.0.87 () {60 vars in 1158 bytes} [Tue Jun 21 18:34:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:23.665986 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f76f657d-da0e-47d2-ad43-23dedf3fb881 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:23.667003 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f76f657d-da0e-47d2-ad43-23dedf3fb881 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:23.678128 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f76f657d-da0e-47d2-ad43-23dedf3fb881 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:23.678693 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f76f657d-da0e-47d2-ad43-23dedf3fb881 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:23.680072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f76f657d-da0e-47d2-ad43-23dedf3fb881 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:23.680829 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f76f657d-da0e-47d2-ad43-23dedf3fb881 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:23.960226 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f76f657d-da0e-47d2-ad43-23dedf3fb881 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:23.974059 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f76f657d-da0e-47d2-ad43-23dedf3fb881 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c" status: 200 len: 1318 microversion: 2.1 time: 0.313357 Jun 21 18:34:23.975258 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 244/473] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:23 2022] GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:25.008233 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-cd125735-983d-4638-97a6-297ba98643de tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:25.011224 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-cd125735-983d-4638-97a6-297ba98643de tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:25.028284 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cd125735-983d-4638-97a6-297ba98643de tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:25.029372 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cd125735-983d-4638-97a6-297ba98643de tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:25.031558 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cd125735-983d-4638-97a6-297ba98643de tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:25.032885 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cd125735-983d-4638-97a6-297ba98643de tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:25.438682 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-cd125735-983d-4638-97a6-297ba98643de tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:25.467252 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-cd125735-983d-4638-97a6-297ba98643de tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c" status: 200 len: 1318 microversion: 2.1 time: 0.462627 Jun 21 18:34:25.468483 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 230/474] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:24 2022] GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c => generated 1318 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:26.498056 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8b7dc970-11bf-4261-80c7-3d255d41965c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:26.499153 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8b7dc970-11bf-4261-80c7-3d255d41965c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:26.509184 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8b7dc970-11bf-4261-80c7-3d255d41965c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:26.510064 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8b7dc970-11bf-4261-80c7-3d255d41965c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:26.511512 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8b7dc970-11bf-4261-80c7-3d255d41965c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:26.512186 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8b7dc970-11bf-4261-80c7-3d255d41965c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:26.564081 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-7e740556-3bd3-4a59-aa65-c715bfe858d3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-444585583", "imageRef": "c28659fb-c2d3-4dda-a330-1323a974987e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "29d4e26f-e314-4e70-8390-44e86b316d90"}], "security_groups": [{"name": "tempest-securitygroup--1663427223"}], "key_name": "tempest-keypair-1520450228", "user_data": "}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:26.788294 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-8b7dc970-11bf-4261-80c7-3d255d41965c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:26.804793 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8b7dc970-11bf-4261-80c7-3d255d41965c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c" status: 200 len: 1506 microversion: 2.1 time: 0.311736 Jun 21 18:34:26.815885 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 245/475] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:26 2022] GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:26.824372 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.network.neutron [None req-7e740556-3bd3-4a59-aa65-c715bfe858d3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] validate_networks() for [('29d4e26f-e314-4e70-8390-44e86b316d90', None, None, None, None, None)] {{(pid=118108) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:34:26.832045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f3b577b7-d36d-4a23-bb73-fe3f5a206cf1 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b6abb82-841b-4e15-a45e-30c704ea313c", "device": "/dev/sdb"}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:26.835293 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f3b577b7-d36d-4a23-bb73-fe3f5a206cf1 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:26.851778 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f3b577b7-d36d-4a23-bb73-fe3f5a206cf1 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:26.854284 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f3b577b7-d36d-4a23-bb73-fe3f5a206cf1 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:26.856072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f3b577b7-d36d-4a23-bb73-fe3f5a206cf1 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:26.856827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f3b577b7-d36d-4a23-bb73-fe3f5a206cf1 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:27.632026 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-7e740556-3bd3-4a59-aa65-c715bfe858d3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Flavor limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:34:27.632586 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-7e740556-3bd3-4a59-aa65-c715bfe858d3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Image limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:34:27.632911 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-7e740556-3bd3-4a59-aa65-c715bfe858d3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Flavor pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:34:27.633308 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-7e740556-3bd3-4a59-aa65-c715bfe858d3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Image pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:34:27.633759 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-7e740556-3bd3-4a59-aa65-c715bfe858d3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:34:27.646869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7e740556-3bd3-4a59-aa65-c715bfe858d3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:27.647359 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7e740556-3bd3-4a59-aa65-c715bfe858d3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:27.648199 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7e740556-3bd3-4a59-aa65-c715bfe858d3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:27.648719 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7e740556-3bd3-4a59-aa65-c715bfe858d3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:27.676497 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-7e740556-3bd3-4a59-aa65-c715bfe858d3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Getting quotas for project 53e2bb9f793041c2aef6e222b76c3961. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:34:27.684836 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-7e740556-3bd3-4a59-aa65-c715bfe858d3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Getting quotas for user 144c9c31ed9b469aa200dcb16c89ab4e and project 53e2bb9f793041c2aef6e222b76c3961. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:34:27.704646 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-7e740556-3bd3-4a59-aa65-c715bfe858d3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Going to run 1 instances... {{(pid=118108) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:34:27.709027 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-7e740556-3bd3-4a59-aa65-c715bfe858d3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c28659fb-c2d3-4dda-a330-1323a974987e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118108) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:34:27.780754 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-7e740556-3bd3-4a59-aa65-c715bfe858d3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.223958 Jun 21 18:34:27.781723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 231/476] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:34:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 18:34:27.800093 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-1e5f4f9d-b6fa-4a69-9cc8-1a319cb3b180 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:27.800975 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-1e5f4f9d-b6fa-4a69-9cc8-1a319cb3b180 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:27.914661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-1e5f4f9d-b6fa-4a69-9cc8-1a319cb3b180 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:27.929049 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-1e5f4f9d-b6fa-4a69-9cc8-1a319cb3b180 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1241 microversion: 2.1 time: 0.136250 Jun 21 18:34:27.930866 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 232/477] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:27 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1241 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:34:28.962352 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d2f9f08e-3720-4d48-9ab7-4151905763a3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:28.963899 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-d2f9f08e-3720-4d48-9ab7-4151905763a3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:28.978156 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d2f9f08e-3720-4d48-9ab7-4151905763a3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:28.979123 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d2f9f08e-3720-4d48-9ab7-4151905763a3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:28.981036 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d2f9f08e-3720-4d48-9ab7-4151905763a3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:28.982008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d2f9f08e-3720-4d48-9ab7-4151905763a3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:29.128805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-d2f9f08e-3720-4d48-9ab7-4151905763a3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:29.144219 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-d2f9f08e-3720-4d48-9ab7-4151905763a3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1245 microversion: 2.1 time: 0.188743 Jun 21 18:34:29.144219 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 233/478] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:28 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1245 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:34:30.171209 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-3b676fee-175e-4b2e-97fd-03acef3f45db tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:30.172278 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-3b676fee-175e-4b2e-97fd-03acef3f45db tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:30.185171 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3b676fee-175e-4b2e-97fd-03acef3f45db tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:30.185991 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3b676fee-175e-4b2e-97fd-03acef3f45db tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:30.187482 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3b676fee-175e-4b2e-97fd-03acef3f45db tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:30.188270 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3b676fee-175e-4b2e-97fd-03acef3f45db tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:30.305333 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-3b676fee-175e-4b2e-97fd-03acef3f45db tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:30.322849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-3b676fee-175e-4b2e-97fd-03acef3f45db tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1245 microversion: 2.1 time: 0.157341 Jun 21 18:34:30.324175 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 234/479] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:30 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1245 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:34:31.331121 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f3b577b7-d36d-4a23-bb73-fe3f5a206cf1 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "POST /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.506907 Jun 21 18:34:31.332723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 246/480] 10.222.0.87 () {60 vars in 1322 bytes} [Tue Jun 21 18:34:26 2022] POST /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c/os-volume_attachments => generated 194 bytes in 4510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:31.355592 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b81dad5c-3898-4d3f-94ab-7a3ece7d912b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:31.356959 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b81dad5c-3898-4d3f-94ab-7a3ece7d912b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:31.370304 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b81dad5c-3898-4d3f-94ab-7a3ece7d912b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:31.371116 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b81dad5c-3898-4d3f-94ab-7a3ece7d912b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:31.372673 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b81dad5c-3898-4d3f-94ab-7a3ece7d912b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:31.373793 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b81dad5c-3898-4d3f-94ab-7a3ece7d912b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:31.478029 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-b81dad5c-3898-4d3f-94ab-7a3ece7d912b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:31.492087 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b81dad5c-3898-4d3f-94ab-7a3ece7d912b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1245 microversion: 2.1 time: 0.143805 Jun 21 18:34:31.493612 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 235/481] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:31 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1245 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:32.514244 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-9d0ce11d-7d48-4b48-b764-8e3cee0acf58 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:32.515501 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-9d0ce11d-7d48-4b48-b764-8e3cee0acf58 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:32.524320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9d0ce11d-7d48-4b48-b764-8e3cee0acf58 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:32.525235 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9d0ce11d-7d48-4b48-b764-8e3cee0acf58 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:32.526859 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9d0ce11d-7d48-4b48-b764-8e3cee0acf58 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:32.527324 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9d0ce11d-7d48-4b48-b764-8e3cee0acf58 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:32.617565 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-9d0ce11d-7d48-4b48-b764-8e3cee0acf58 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:32.631338 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-9d0ce11d-7d48-4b48-b764-8e3cee0acf58 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1237 microversion: 2.1 time: 0.122461 Jun 21 18:34:32.632213 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 247/482] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:32 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1237 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:33.656866 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-1e79c415-58f3-4d8b-a8ae-58281f74ded9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:33.657968 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-1e79c415-58f3-4d8b-a8ae-58281f74ded9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:33.671573 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1e79c415-58f3-4d8b-a8ae-58281f74ded9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:33.672313 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1e79c415-58f3-4d8b-a8ae-58281f74ded9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:33.674284 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1e79c415-58f3-4d8b-a8ae-58281f74ded9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:33.675056 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1e79c415-58f3-4d8b-a8ae-58281f74ded9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:33.743452 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-fec18b57-efca-40c6-ae80-ec7d87d48923 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:33.759483 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fec18b57-efca-40c6-ae80-ec7d87d48923 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:33.759998 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fec18b57-efca-40c6-ae80-ec7d87d48923 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:33.809749 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-1e79c415-58f3-4d8b-a8ae-58281f74ded9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:33.819774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-1e79c415-58f3-4d8b-a8ae-58281f74ded9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1299 microversion: 2.1 time: 0.169568 Jun 21 18:34:33.821942 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 236/483] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:33 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:33.874452 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-fec18b57-efca-40c6-ae80-ec7d87d48923 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Going to try to stop instance {{(pid=118109) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 18:34:33.951582 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:33.968460 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-fec18b57-efca-40c6-ae80-ec7d87d48923 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "POST /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e/action" status: 202 len: 0 microversion: 2.1 time: 0.233003 Jun 21 18:34:33.969792 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 248/484] 10.222.0.87 () {60 vars in 1277 bytes} [Tue Jun 21 18:34:33 2022] POST /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:34:33.980696 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c4bb8a53-7872-4003-b9ca-d6172a193cb5 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:33.981404 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c4bb8a53-7872-4003-b9ca-d6172a193cb5 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:33.991932 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c4bb8a53-7872-4003-b9ca-d6172a193cb5 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:33.992651 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c4bb8a53-7872-4003-b9ca-d6172a193cb5 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:33.994493 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c4bb8a53-7872-4003-b9ca-d6172a193cb5 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:33.995517 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c4bb8a53-7872-4003-b9ca-d6172a193cb5 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:34.210054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c4bb8a53-7872-4003-b9ca-d6172a193cb5 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:34.226681 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c4bb8a53-7872-4003-b9ca-d6172a193cb5 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1723 microversion: 2.1 time: 0.250189 Jun 21 18:34:34.227553 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 237/485] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:33 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:34.849399 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-d98d0e00-c909-46d9-a549-73cfccb4e947 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:34.850383 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-d98d0e00-c909-46d9-a549-73cfccb4e947 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:34.857150 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:34.870730 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d98d0e00-c909-46d9-a549-73cfccb4e947 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:34.871262 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d98d0e00-c909-46d9-a549-73cfccb4e947 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:34.872801 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d98d0e00-c909-46d9-a549-73cfccb4e947 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:34.873310 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d98d0e00-c909-46d9-a549-73cfccb4e947 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:35.112427 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-d98d0e00-c909-46d9-a549-73cfccb4e947 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:35.132177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-d98d0e00-c909-46d9-a549-73cfccb4e947 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1367 microversion: 2.1 time: 0.286551 Jun 21 18:34:35.132177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 249/486] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:34 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:35.254338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-aaa54b50-11e1-49aa-898c-ff23e645f143 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:35.255361 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-aaa54b50-11e1-49aa-898c-ff23e645f143 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:35.265545 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-aaa54b50-11e1-49aa-898c-ff23e645f143 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:35.266052 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-aaa54b50-11e1-49aa-898c-ff23e645f143 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:35.267031 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-aaa54b50-11e1-49aa-898c-ff23e645f143 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:35.267500 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-aaa54b50-11e1-49aa-898c-ff23e645f143 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:35.496121 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-aaa54b50-11e1-49aa-898c-ff23e645f143 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:35.512991 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-aaa54b50-11e1-49aa-898c-ff23e645f143 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1723 microversion: 2.1 time: 0.266595 Jun 21 18:34:35.514052 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 238/487] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:35 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:35.912567 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-844bc3f9-0a89-40f2-8d0b-51b0f09dbd18 req-33943f2e-06de-4c8d-8190-10856bdaad1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0311fe1f-2643-49b9-89a6-ebfb7d63430a", "tag": "13df5c0e-52fd-4978-9066-7de50f0ca9a5"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:35.930302 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-844bc3f9-0a89-40f2-8d0b-51b0f09dbd18 req-33943f2e-06de-4c8d-8190-10856bdaad1c service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:35.931314 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-844bc3f9-0a89-40f2-8d0b-51b0f09dbd18 req-33943f2e-06de-4c8d-8190-10856bdaad1c service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:35.955528 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-844bc3f9-0a89-40f2-8d0b-51b0f09dbd18 req-33943f2e-06de-4c8d-8190-10856bdaad1c service nova] Creating event network-changed:13df5c0e-52fd-4978-9066-7de50f0ca9a5 for instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a on hv-cinder-84460 Jun 21 18:34:35.969248 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-844bc3f9-0a89-40f2-8d0b-51b0f09dbd18 req-33943f2e-06de-4c8d-8190-10856bdaad1c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082435 Jun 21 18:34:35.973990 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 250/488] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:34:36.164200 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-05b3bcf6-39c0-4fac-aeb9-4a68c31a72f5 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:36.164906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-05b3bcf6-39c0-4fac-aeb9-4a68c31a72f5 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:36.175138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-05b3bcf6-39c0-4fac-aeb9-4a68c31a72f5 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:36.175978 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-05b3bcf6-39c0-4fac-aeb9-4a68c31a72f5 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:36.177356 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-05b3bcf6-39c0-4fac-aeb9-4a68c31a72f5 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:36.178226 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-05b3bcf6-39c0-4fac-aeb9-4a68c31a72f5 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:36.382993 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-05b3bcf6-39c0-4fac-aeb9-4a68c31a72f5 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:36.392451 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-05b3bcf6-39c0-4fac-aeb9-4a68c31a72f5 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1367 microversion: 2.1 time: 0.233942 Jun 21 18:34:36.393352 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 239/489] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:36 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:36.565014 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-73b195ff-f700-4742-a660-74a5e202332b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:36.566382 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-73b195ff-f700-4742-a660-74a5e202332b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:36.578253 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-73b195ff-f700-4742-a660-74a5e202332b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:36.579049 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-73b195ff-f700-4742-a660-74a5e202332b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:36.580472 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-73b195ff-f700-4742-a660-74a5e202332b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:36.581261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-73b195ff-f700-4742-a660-74a5e202332b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:36.811339 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-73b195ff-f700-4742-a660-74a5e202332b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:36.823866 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-73b195ff-f700-4742-a660-74a5e202332b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1723 microversion: 2.1 time: 0.271306 Jun 21 18:34:36.824567 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 251/490] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:36 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:37.411776 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-27f877b0-1bed-443e-94fa-1f7a84b13e13 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:37.412810 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-27f877b0-1bed-443e-94fa-1f7a84b13e13 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:37.420563 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-27f877b0-1bed-443e-94fa-1f7a84b13e13 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:37.421154 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-27f877b0-1bed-443e-94fa-1f7a84b13e13 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:37.422114 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-27f877b0-1bed-443e-94fa-1f7a84b13e13 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:37.422669 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-27f877b0-1bed-443e-94fa-1f7a84b13e13 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:37.427764 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:37.633518 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-27f877b0-1bed-443e-94fa-1f7a84b13e13 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:37.642156 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-27f877b0-1bed-443e-94fa-1f7a84b13e13 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1367 microversion: 2.1 time: 0.235674 Jun 21 18:34:37.642758 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 240/491] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:37 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:34:37.843755 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b573c3be-7681-4a72-9572-89cd72d4a4a2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:37.844756 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b573c3be-7681-4a72-9572-89cd72d4a4a2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:37.857239 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b573c3be-7681-4a72-9572-89cd72d4a4a2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:37.857995 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b573c3be-7681-4a72-9572-89cd72d4a4a2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:37.859232 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b573c3be-7681-4a72-9572-89cd72d4a4a2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:37.859897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b573c3be-7681-4a72-9572-89cd72d4a4a2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:38.068123 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b573c3be-7681-4a72-9572-89cd72d4a4a2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:38.090730 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b573c3be-7681-4a72-9572-89cd72d4a4a2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1723 microversion: 2.1 time: 0.243786 Jun 21 18:34:38.090730 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 252/492] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:37 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:38.663634 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-0747ec7d-20d0-4872-8658-1afb53c6f4f3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:38.664787 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-0747ec7d-20d0-4872-8658-1afb53c6f4f3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:38.668710 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=2 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:38.670132 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=12 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:38.683225 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0747ec7d-20d0-4872-8658-1afb53c6f4f3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:38.684020 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0747ec7d-20d0-4872-8658-1afb53c6f4f3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:38.685666 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0747ec7d-20d0-4872-8658-1afb53c6f4f3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:38.686573 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0747ec7d-20d0-4872-8658-1afb53c6f4f3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:38.931614 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-0747ec7d-20d0-4872-8658-1afb53c6f4f3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:38.940980 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-0747ec7d-20d0-4872-8658-1afb53c6f4f3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1367 microversion: 2.1 time: 0.284784 Jun 21 18:34:38.942041 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 241/493] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:38 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:39.112355 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-57eaec77-8fb9-4907-8445-502700063370 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:39.117261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-57eaec77-8fb9-4907-8445-502700063370 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:39.130845 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-57eaec77-8fb9-4907-8445-502700063370 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:39.131797 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-57eaec77-8fb9-4907-8445-502700063370 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:39.133117 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-57eaec77-8fb9-4907-8445-502700063370 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:39.133867 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-57eaec77-8fb9-4907-8445-502700063370 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:39.384597 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-57eaec77-8fb9-4907-8445-502700063370 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:39.400772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-57eaec77-8fb9-4907-8445-502700063370 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1723 microversion: 2.1 time: 0.295368 Jun 21 18:34:39.402206 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 253/494] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:39 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:39.964070 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-436cbda0-c980-4a08-9d9f-210431826ceb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:39.965099 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-436cbda0-c980-4a08-9d9f-210431826ceb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:39.969043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:39.980539 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-436cbda0-c980-4a08-9d9f-210431826ceb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:39.981319 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-436cbda0-c980-4a08-9d9f-210431826ceb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:39.982779 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-436cbda0-c980-4a08-9d9f-210431826ceb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:39.983553 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-436cbda0-c980-4a08-9d9f-210431826ceb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:40.217345 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-436cbda0-c980-4a08-9d9f-210431826ceb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:40.232332 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-436cbda0-c980-4a08-9d9f-210431826ceb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1367 microversion: 2.1 time: 0.275175 Jun 21 18:34:40.233532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 242/495] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:39 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:40.425354 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-822ba848-3c6d-4153-aa14-656b6b509943 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:40.426378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-822ba848-3c6d-4153-aa14-656b6b509943 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:40.438308 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-822ba848-3c6d-4153-aa14-656b6b509943 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:40.439080 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-822ba848-3c6d-4153-aa14-656b6b509943 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:40.440506 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-822ba848-3c6d-4153-aa14-656b6b509943 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:40.441428 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-822ba848-3c6d-4153-aa14-656b6b509943 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:40.692483 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-822ba848-3c6d-4153-aa14-656b6b509943 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:40.708367 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-822ba848-3c6d-4153-aa14-656b6b509943 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1723 microversion: 2.1 time: 0.290485 Jun 21 18:34:40.719024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 254/496] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:40 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:41.270403 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-06466abf-7ca7-4454-ac55-a985d6031bb6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:41.271895 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-06466abf-7ca7-4454-ac55-a985d6031bb6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:41.284574 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-06466abf-7ca7-4454-ac55-a985d6031bb6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:41.285584 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-06466abf-7ca7-4454-ac55-a985d6031bb6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:41.287502 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-06466abf-7ca7-4454-ac55-a985d6031bb6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:41.288399 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-06466abf-7ca7-4454-ac55-a985d6031bb6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:41.532042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-06466abf-7ca7-4454-ac55-a985d6031bb6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:41.543066 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-06466abf-7ca7-4454-ac55-a985d6031bb6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1367 microversion: 2.1 time: 0.283274 Jun 21 18:34:41.543653 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 243/497] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:41 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:41.730720 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-59e70e55-4a66-4d7d-b191-3fe275b14f82 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:41.731734 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-59e70e55-4a66-4d7d-b191-3fe275b14f82 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:41.744041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-59e70e55-4a66-4d7d-b191-3fe275b14f82 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:41.744764 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-59e70e55-4a66-4d7d-b191-3fe275b14f82 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:41.746216 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-59e70e55-4a66-4d7d-b191-3fe275b14f82 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:41.746999 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-59e70e55-4a66-4d7d-b191-3fe275b14f82 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:41.959041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-59e70e55-4a66-4d7d-b191-3fe275b14f82 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:41.972348 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-59e70e55-4a66-4d7d-b191-3fe275b14f82 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1723 microversion: 2.1 time: 0.248572 Jun 21 18:34:41.973238 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 255/498] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:41 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:42.567437 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-bb9a303f-c2b3-4766-bd8e-ada7af7a90e6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:42.568429 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-bb9a303f-c2b3-4766-bd8e-ada7af7a90e6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:42.580052 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bb9a303f-c2b3-4766-bd8e-ada7af7a90e6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:42.580848 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bb9a303f-c2b3-4766-bd8e-ada7af7a90e6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:42.582835 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bb9a303f-c2b3-4766-bd8e-ada7af7a90e6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:42.583635 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bb9a303f-c2b3-4766-bd8e-ada7af7a90e6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:42.814199 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-bb9a303f-c2b3-4766-bd8e-ada7af7a90e6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:42.824589 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-bb9a303f-c2b3-4766-bd8e-ada7af7a90e6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1367 microversion: 2.1 time: 0.264214 Jun 21 18:34:42.825975 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 244/499] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:42 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:43.001582 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-253257cb-6658-4d48-bef0-ac4464c1a7ad tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:43.002580 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-253257cb-6658-4d48-bef0-ac4464c1a7ad tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:43.011053 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-253257cb-6658-4d48-bef0-ac4464c1a7ad tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:43.011501 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-253257cb-6658-4d48-bef0-ac4464c1a7ad tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:43.013041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-253257cb-6658-4d48-bef0-ac4464c1a7ad tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:43.013517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-253257cb-6658-4d48-bef0-ac4464c1a7ad tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:43.219264 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-253257cb-6658-4d48-bef0-ac4464c1a7ad tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:43.235147 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-253257cb-6658-4d48-bef0-ac4464c1a7ad tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1723 microversion: 2.1 time: 0.237930 Jun 21 18:34:43.235823 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 256/500] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:42 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:43.857603 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-86418381-953c-4c43-bf66-fb1ac9fce5a6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:43.858771 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-86418381-953c-4c43-bf66-fb1ac9fce5a6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:43.870982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-86418381-953c-4c43-bf66-fb1ac9fce5a6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:43.871759 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-86418381-953c-4c43-bf66-fb1ac9fce5a6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:43.873106 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-86418381-953c-4c43-bf66-fb1ac9fce5a6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:43.873955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-86418381-953c-4c43-bf66-fb1ac9fce5a6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:44.116795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-86418381-953c-4c43-bf66-fb1ac9fce5a6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:44.132010 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-86418381-953c-4c43-bf66-fb1ac9fce5a6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1367 microversion: 2.1 time: 0.281250 Jun 21 18:34:44.133026 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 245/501] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:43 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:44.263495 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b1aaa8d4-5569-4641-8505-c5536d00f049 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:44.264631 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b1aaa8d4-5569-4641-8505-c5536d00f049 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:44.276569 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b1aaa8d4-5569-4641-8505-c5536d00f049 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:44.277288 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b1aaa8d4-5569-4641-8505-c5536d00f049 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:44.278685 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b1aaa8d4-5569-4641-8505-c5536d00f049 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:44.279367 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b1aaa8d4-5569-4641-8505-c5536d00f049 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:44.518080 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b1aaa8d4-5569-4641-8505-c5536d00f049 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:44.534358 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b1aaa8d4-5569-4641-8505-c5536d00f049 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1723 microversion: 2.1 time: 0.277213 Jun 21 18:34:44.535489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 257/502] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:44 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:45.155719 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-722c83da-4703-43d0-a0fa-fc53fd68a2af tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:45.156796 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-722c83da-4703-43d0-a0fa-fc53fd68a2af tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:45.169075 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-722c83da-4703-43d0-a0fa-fc53fd68a2af tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:45.169897 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-722c83da-4703-43d0-a0fa-fc53fd68a2af tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:45.171296 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-722c83da-4703-43d0-a0fa-fc53fd68a2af tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:45.172034 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-722c83da-4703-43d0-a0fa-fc53fd68a2af tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:45.427328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-722c83da-4703-43d0-a0fa-fc53fd68a2af tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:45.438546 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-722c83da-4703-43d0-a0fa-fc53fd68a2af tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1367 microversion: 2.1 time: 0.289160 Jun 21 18:34:45.439492 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 246/503] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:45 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:45.561330 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-31726654-1512-4a99-a790-c0762e4c2b21 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:45.562239 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-31726654-1512-4a99-a790-c0762e4c2b21 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:45.572270 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-31726654-1512-4a99-a790-c0762e4c2b21 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:45.572937 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-31726654-1512-4a99-a790-c0762e4c2b21 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:45.574215 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-31726654-1512-4a99-a790-c0762e4c2b21 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:45.574890 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-31726654-1512-4a99-a790-c0762e4c2b21 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:45.801113 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-31726654-1512-4a99-a790-c0762e4c2b21 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:45.811241 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-31726654-1512-4a99-a790-c0762e4c2b21 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1723 microversion: 2.1 time: 0.253753 Jun 21 18:34:45.811840 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 258/504] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:45 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:46.465961 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e1045885-e608-494f-83f6-f84f4a549687 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:46.467121 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e1045885-e608-494f-83f6-f84f4a549687 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:46.479876 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e1045885-e608-494f-83f6-f84f4a549687 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:46.480674 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e1045885-e608-494f-83f6-f84f4a549687 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:46.482127 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e1045885-e608-494f-83f6-f84f4a549687 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:46.482922 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e1045885-e608-494f-83f6-f84f4a549687 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:46.716091 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e1045885-e608-494f-83f6-f84f4a549687 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:46.731026 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e1045885-e608-494f-83f6-f84f4a549687 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1367 microversion: 2.1 time: 0.272333 Jun 21 18:34:46.732108 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 247/505] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:46 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:46.832475 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-45c364b4-dae2-46e7-a2bf-a3995788e23d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:46.833414 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-45c364b4-dae2-46e7-a2bf-a3995788e23d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:46.841823 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-45c364b4-dae2-46e7-a2bf-a3995788e23d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:46.842439 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-45c364b4-dae2-46e7-a2bf-a3995788e23d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:46.843801 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-45c364b4-dae2-46e7-a2bf-a3995788e23d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:46.844575 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-45c364b4-dae2-46e7-a2bf-a3995788e23d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:47.064013 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-45c364b4-dae2-46e7-a2bf-a3995788e23d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:47.077497 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-45c364b4-dae2-46e7-a2bf-a3995788e23d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1723 microversion: 2.1 time: 0.249238 Jun 21 18:34:47.078565 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 259/506] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:46 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:34:47.760500 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4b76d380-ab77-49ac-976c-923bb2eadc33 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:47.761581 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4b76d380-ab77-49ac-976c-923bb2eadc33 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:47.771065 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4b76d380-ab77-49ac-976c-923bb2eadc33 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:47.771561 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4b76d380-ab77-49ac-976c-923bb2eadc33 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:47.772456 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4b76d380-ab77-49ac-976c-923bb2eadc33 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:47.772953 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4b76d380-ab77-49ac-976c-923bb2eadc33 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:47.967513 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-4b76d380-ab77-49ac-976c-923bb2eadc33 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:47.978752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4b76d380-ab77-49ac-976c-923bb2eadc33 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1367 microversion: 2.1 time: 0.224488 Jun 21 18:34:47.979369 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 248/507] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:47 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:48.105894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6fcbb40e-980c-43ca-ba6a-64f0c1165174 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:48.105894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6fcbb40e-980c-43ca-ba6a-64f0c1165174 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:48.109984 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6fcbb40e-980c-43ca-ba6a-64f0c1165174 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:48.110745 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6fcbb40e-980c-43ca-ba6a-64f0c1165174 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:48.111741 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6fcbb40e-980c-43ca-ba6a-64f0c1165174 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:48.112380 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6fcbb40e-980c-43ca-ba6a-64f0c1165174 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:48.493975 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-6fcbb40e-980c-43ca-ba6a-64f0c1165174 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:48.503463 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6fcbb40e-980c-43ca-ba6a-64f0c1165174 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1723 microversion: 2.1 time: 0.409422 Jun 21 18:34:48.513800 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 260/508] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:48 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1723 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:34:48.869695 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-36e256f0-1146-41d4-a46b-fc8fd857d639 req-1a3f0347-81cb-4b98-9bcd-b677dd4d91dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0311fe1f-2643-49b9-89a6-ebfb7d63430a", "name": "network-vif-plugged", "status": "completed", "tag": "13df5c0e-52fd-4978-9066-7de50f0ca9a5"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:48.886058 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-36e256f0-1146-41d4-a46b-fc8fd857d639 req-1a3f0347-81cb-4b98-9bcd-b677dd4d91dd service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:48.886939 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-36e256f0-1146-41d4-a46b-fc8fd857d639 req-1a3f0347-81cb-4b98-9bcd-b677dd4d91dd service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:48.920202 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-36e256f0-1146-41d4-a46b-fc8fd857d639 req-1a3f0347-81cb-4b98-9bcd-b677dd4d91dd service nova] Creating event network-vif-plugged:13df5c0e-52fd-4978-9066-7de50f0ca9a5 for instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a on hv-cinder-84460 Jun 21 18:34:48.929097 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-36e256f0-1146-41d4-a46b-fc8fd857d639 req-1a3f0347-81cb-4b98-9bcd-b677dd4d91dd service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066963 Jun 21 18:34:48.930532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 249/509] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:49.010874 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c241cc21-c1ed-4236-8363-b4f02c1775cf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:49.012086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c241cc21-c1ed-4236-8363-b4f02c1775cf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:49.026386 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c241cc21-c1ed-4236-8363-b4f02c1775cf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:49.026871 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c241cc21-c1ed-4236-8363-b4f02c1775cf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:49.028320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c241cc21-c1ed-4236-8363-b4f02c1775cf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:49.028880 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c241cc21-c1ed-4236-8363-b4f02c1775cf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:49.256302 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c241cc21-c1ed-4236-8363-b4f02c1775cf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:49.268018 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c241cc21-c1ed-4236-8363-b4f02c1775cf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1367 microversion: 2.1 time: 0.265072 Jun 21 18:34:49.268618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 261/510] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:49 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:49.526146 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2be78adf-ecd2-4130-8ce7-fd0663b278fa tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:49.527649 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-2be78adf-ecd2-4130-8ce7-fd0663b278fa tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:49.540199 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2be78adf-ecd2-4130-8ce7-fd0663b278fa tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:49.540984 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2be78adf-ecd2-4130-8ce7-fd0663b278fa tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:49.542403 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2be78adf-ecd2-4130-8ce7-fd0663b278fa tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:49.543159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2be78adf-ecd2-4130-8ce7-fd0663b278fa tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:49.786028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2be78adf-ecd2-4130-8ce7-fd0663b278fa tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:49.799020 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2be78adf-ecd2-4130-8ce7-fd0663b278fa tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1723 microversion: 2.1 time: 0.281353 Jun 21 18:34:49.799847 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 250/511] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:49 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:50.289572 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e4121fc7-9e58-47ad-841d-6834cf008969 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:50.290393 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e4121fc7-9e58-47ad-841d-6834cf008969 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:50.298238 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e4121fc7-9e58-47ad-841d-6834cf008969 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:50.298704 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e4121fc7-9e58-47ad-841d-6834cf008969 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:50.299499 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e4121fc7-9e58-47ad-841d-6834cf008969 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:50.300057 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e4121fc7-9e58-47ad-841d-6834cf008969 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:50.520246 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e4121fc7-9e58-47ad-841d-6834cf008969 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:50.528637 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e4121fc7-9e58-47ad-841d-6834cf008969 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1367 microversion: 2.1 time: 0.244500 Jun 21 18:34:50.529300 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 262/512] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:50 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:50.826656 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-49687945-71de-4f33-9943-d0d3f150fec0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:50.827700 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-49687945-71de-4f33-9943-d0d3f150fec0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:50.838701 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-49687945-71de-4f33-9943-d0d3f150fec0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:50.839238 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-49687945-71de-4f33-9943-d0d3f150fec0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:50.840416 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-49687945-71de-4f33-9943-d0d3f150fec0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:50.841024 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-49687945-71de-4f33-9943-d0d3f150fec0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:51.057520 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-49687945-71de-4f33-9943-d0d3f150fec0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:51.072427 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-49687945-71de-4f33-9943-d0d3f150fec0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1723 microversion: 2.1 time: 0.251936 Jun 21 18:34:51.073371 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 251/513] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:50 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:51.551816 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-d3cc5312-ea14-419b-912c-aa1d3793936f tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:51.552618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-d3cc5312-ea14-419b-912c-aa1d3793936f tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:51.564313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d3cc5312-ea14-419b-912c-aa1d3793936f tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:51.565069 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d3cc5312-ea14-419b-912c-aa1d3793936f tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:51.566650 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d3cc5312-ea14-419b-912c-aa1d3793936f tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:51.567406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d3cc5312-ea14-419b-912c-aa1d3793936f tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:51.777082 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-d3cc5312-ea14-419b-912c-aa1d3793936f tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:51.786843 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-d3cc5312-ea14-419b-912c-aa1d3793936f tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1367 microversion: 2.1 time: 0.239858 Jun 21 18:34:51.787442 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 263/514] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:51 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:52.102692 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-14bb88a5-3452-4a5f-ab8c-16652407b890 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:52.103720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-14bb88a5-3452-4a5f-ab8c-16652407b890 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:52.115765 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-14bb88a5-3452-4a5f-ab8c-16652407b890 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:52.116542 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-14bb88a5-3452-4a5f-ab8c-16652407b890 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:52.118038 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-14bb88a5-3452-4a5f-ab8c-16652407b890 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:52.118816 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-14bb88a5-3452-4a5f-ab8c-16652407b890 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:52.323238 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-14bb88a5-3452-4a5f-ab8c-16652407b890 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:52.338450 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-14bb88a5-3452-4a5f-ab8c-16652407b890 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1723 microversion: 2.1 time: 0.243643 Jun 21 18:34:52.339549 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 252/515] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:52 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:52.806479 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6cf6a3b3-22a6-43ac-921f-64d7a0606b0e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:52.807442 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6cf6a3b3-22a6-43ac-921f-64d7a0606b0e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:52.817931 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6cf6a3b3-22a6-43ac-921f-64d7a0606b0e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:52.818590 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6cf6a3b3-22a6-43ac-921f-64d7a0606b0e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:52.819555 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6cf6a3b3-22a6-43ac-921f-64d7a0606b0e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:52.820117 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6cf6a3b3-22a6-43ac-921f-64d7a0606b0e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:53.024902 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-6cf6a3b3-22a6-43ac-921f-64d7a0606b0e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:53.033403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6cf6a3b3-22a6-43ac-921f-64d7a0606b0e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1367 microversion: 2.1 time: 0.232664 Jun 21 18:34:53.034095 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 264/516] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:52 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:34:53.370313 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-cbee637f-2dcd-4c87-816e-4f9e3b9778e3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:53.372290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-cbee637f-2dcd-4c87-816e-4f9e3b9778e3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:53.386298 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cbee637f-2dcd-4c87-816e-4f9e3b9778e3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:53.387298 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cbee637f-2dcd-4c87-816e-4f9e3b9778e3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:53.388546 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cbee637f-2dcd-4c87-816e-4f9e3b9778e3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:53.389442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cbee637f-2dcd-4c87-816e-4f9e3b9778e3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:53.588885 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-cbee637f-2dcd-4c87-816e-4f9e3b9778e3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:53.598392 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-cbee637f-2dcd-4c87-816e-4f9e3b9778e3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1700 microversion: 2.1 time: 0.236324 Jun 21 18:34:53.599004 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 253/517] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:53 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1700 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:53.626605 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-612dc4d3-513f-4077-b2ec-a5841db9f0d3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:34:53.634088 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-612dc4d3-513f-4077-b2ec-a5841db9f0d3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:53.634613 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-612dc4d3-513f-4077-b2ec-a5841db9f0d3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:53.661675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-612dc4d3-513f-4077-b2ec-a5841db9f0d3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Going to try to start instance {{(pid=118109) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 18:34:53.679176 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:53.728492 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-612dc4d3-513f-4077-b2ec-a5841db9f0d3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "POST /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e/action" status: 202 len: 0 microversion: 2.1 time: 0.111153 Jun 21 18:34:53.729585 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 265/518] 10.222.0.87 () {60 vars in 1277 bytes} [Tue Jun 21 18:34:53 2022] POST /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:34:53.743118 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e821dc0e-9327-48a4-8034-5700e9f1df6f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:53.744238 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e821dc0e-9327-48a4-8034-5700e9f1df6f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:53.756180 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e821dc0e-9327-48a4-8034-5700e9f1df6f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:53.756986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e821dc0e-9327-48a4-8034-5700e9f1df6f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:53.758586 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e821dc0e-9327-48a4-8034-5700e9f1df6f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:53.759336 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e821dc0e-9327-48a4-8034-5700e9f1df6f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:54.013517 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e821dc0e-9327-48a4-8034-5700e9f1df6f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:54.027987 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e821dc0e-9327-48a4-8034-5700e9f1df6f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1709 microversion: 2.1 time: 0.293080 Jun 21 18:34:54.029006 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 254/519] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:53 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1709 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:54.059818 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-844bb520-f4fb-4027-94b0-f971aac8480b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:54.061368 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-844bb520-f4fb-4027-94b0-f971aac8480b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:54.073741 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-844bb520-f4fb-4027-94b0-f971aac8480b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:54.074431 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-844bb520-f4fb-4027-94b0-f971aac8480b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:54.075873 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-844bb520-f4fb-4027-94b0-f971aac8480b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:54.076863 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-844bb520-f4fb-4027-94b0-f971aac8480b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:54.324942 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-844bb520-f4fb-4027-94b0-f971aac8480b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:54.340563 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-844bb520-f4fb-4027-94b0-f971aac8480b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1367 microversion: 2.1 time: 0.290290 Jun 21 18:34:54.341664 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 266/520] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:54 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:34:55.053677 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-39339f53-37ea-427b-8a2e-ed0d728f2923 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:55.054573 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-39339f53-37ea-427b-8a2e-ed0d728f2923 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:55.062172 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-39339f53-37ea-427b-8a2e-ed0d728f2923 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:55.063149 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-39339f53-37ea-427b-8a2e-ed0d728f2923 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:55.063774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-39339f53-37ea-427b-8a2e-ed0d728f2923 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:55.064412 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-39339f53-37ea-427b-8a2e-ed0d728f2923 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:55.308731 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-39339f53-37ea-427b-8a2e-ed0d728f2923 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:55.327527 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-39339f53-37ea-427b-8a2e-ed0d728f2923 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1709 microversion: 2.1 time: 0.278208 Jun 21 18:34:55.328241 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 255/521] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:55 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1709 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:55.368883 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1fe6cdd8-e3f6-48b9-ba50-ce3afc36de15 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:55.370189 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1fe6cdd8-e3f6-48b9-ba50-ce3afc36de15 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:55.383699 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1fe6cdd8-e3f6-48b9-ba50-ce3afc36de15 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:55.384470 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1fe6cdd8-e3f6-48b9-ba50-ce3afc36de15 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:55.385901 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1fe6cdd8-e3f6-48b9-ba50-ce3afc36de15 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:55.386647 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1fe6cdd8-e3f6-48b9-ba50-ce3afc36de15 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:55.599529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1fe6cdd8-e3f6-48b9-ba50-ce3afc36de15 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:55.610513 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1fe6cdd8-e3f6-48b9-ba50-ce3afc36de15 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1367 microversion: 2.1 time: 0.250081 Jun 21 18:34:55.612117 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 267/522] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:55 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:56.350072 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-8e7c5da8-af19-42ba-a3e0-dd0aae440907 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:56.351311 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-8e7c5da8-af19-42ba-a3e0-dd0aae440907 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:56.361709 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8e7c5da8-af19-42ba-a3e0-dd0aae440907 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:56.362319 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8e7c5da8-af19-42ba-a3e0-dd0aae440907 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:56.363148 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8e7c5da8-af19-42ba-a3e0-dd0aae440907 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:56.363583 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8e7c5da8-af19-42ba-a3e0-dd0aae440907 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:56.572321 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-8e7c5da8-af19-42ba-a3e0-dd0aae440907 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:56.587757 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-8e7c5da8-af19-42ba-a3e0-dd0aae440907 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1709 microversion: 2.1 time: 0.244102 Jun 21 18:34:56.588808 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 256/523] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:56 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1709 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:34:56.644778 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-4ab57715-5b7d-4412-98d0-c598a5164076 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:56.644778 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-4ab57715-5b7d-4412-98d0-c598a5164076 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:56.657182 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4ab57715-5b7d-4412-98d0-c598a5164076 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:56.657984 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4ab57715-5b7d-4412-98d0-c598a5164076 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:56.659469 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4ab57715-5b7d-4412-98d0-c598a5164076 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:56.660263 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4ab57715-5b7d-4412-98d0-c598a5164076 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:56.852239 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-4ab57715-5b7d-4412-98d0-c598a5164076 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:56.860921 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-4ab57715-5b7d-4412-98d0-c598a5164076 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1367 microversion: 2.1 time: 0.224116 Jun 21 18:34:56.861525 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 268/524] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:56 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:57.621368 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-7dc8a1d8-c90e-4bfd-b6db-1c438fde46ca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:57.622654 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-7dc8a1d8-c90e-4bfd-b6db-1c438fde46ca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:57.633012 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7dc8a1d8-c90e-4bfd-b6db-1c438fde46ca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:57.633947 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7dc8a1d8-c90e-4bfd-b6db-1c438fde46ca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:57.635044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7dc8a1d8-c90e-4bfd-b6db-1c438fde46ca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:57.636204 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7dc8a1d8-c90e-4bfd-b6db-1c438fde46ca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:57.672920 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=100 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:34:57.882781 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-150de555-6585-496e-b2b1-f906aa43dda4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:57.883779 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-150de555-6585-496e-b2b1-f906aa43dda4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:57.896911 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-150de555-6585-496e-b2b1-f906aa43dda4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:57.897559 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-150de555-6585-496e-b2b1-f906aa43dda4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:57.902058 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-150de555-6585-496e-b2b1-f906aa43dda4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:57.905254 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-150de555-6585-496e-b2b1-f906aa43dda4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:58.120295 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-7dc8a1d8-c90e-4bfd-b6db-1c438fde46ca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:58.136407 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-7dc8a1d8-c90e-4bfd-b6db-1c438fde46ca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1709 microversion: 2.1 time: 0.524273 Jun 21 18:34:58.138293 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 257/525] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:57 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1709 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:58.280712 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-150de555-6585-496e-b2b1-f906aa43dda4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:58.291245 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-150de555-6585-496e-b2b1-f906aa43dda4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1557 microversion: 2.1 time: 0.412495 Jun 21 18:34:58.291937 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 269/526] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:57 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1557 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:34:58.320663 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b6d0fb3e-72d9-43ad-bdc9-a7921b1c9d37 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:58.321862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b6d0fb3e-72d9-43ad-bdc9-a7921b1c9d37 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:58.332375 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b6d0fb3e-72d9-43ad-bdc9-a7921b1c9d37 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:58.333160 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b6d0fb3e-72d9-43ad-bdc9-a7921b1c9d37 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:58.334202 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b6d0fb3e-72d9-43ad-bdc9-a7921b1c9d37 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:58.334680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b6d0fb3e-72d9-43ad-bdc9-a7921b1c9d37 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:58.509570 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b6d0fb3e-72d9-43ad-bdc9-a7921b1c9d37 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.196029 Jun 21 18:34:58.510738 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 258/527] 10.222.0.87 () {58 vars in 1274 bytes} [Tue Jun 21 18:34:58 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a/os-interface => generated 285 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:34:59.166347 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e56f4c50-a53f-4f75-9101-27b9db46afc7 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:34:59.167077 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e56f4c50-a53f-4f75-9101-27b9db46afc7 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:34:59.176949 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e56f4c50-a53f-4f75-9101-27b9db46afc7 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:59.177547 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e56f4c50-a53f-4f75-9101-27b9db46afc7 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:59.178865 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e56f4c50-a53f-4f75-9101-27b9db46afc7 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:34:59.179310 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e56f4c50-a53f-4f75-9101-27b9db46afc7 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:34:59.604755 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e56f4c50-a53f-4f75-9101-27b9db46afc7 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:34:59.620627 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e56f4c50-a53f-4f75-9101-27b9db46afc7 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1709 microversion: 2.1 time: 0.459604 Jun 21 18:34:59.621711 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 270/528] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:34:59 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1709 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:00.379624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-186de630-53d5-4b08-8932-252804e657cd req-21efca69-5d91-4b84-af20-d88e9923f409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0311fe1f-2643-49b9-89a6-ebfb7d63430a", "tag": "13df5c0e-52fd-4978-9066-7de50f0ca9a5"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:35:00.388673 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-186de630-53d5-4b08-8932-252804e657cd req-21efca69-5d91-4b84-af20-d88e9923f409 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:00.389169 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-186de630-53d5-4b08-8932-252804e657cd req-21efca69-5d91-4b84-af20-d88e9923f409 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:00.402302 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-186de630-53d5-4b08-8932-252804e657cd req-21efca69-5d91-4b84-af20-d88e9923f409 service nova] Creating event network-changed:13df5c0e-52fd-4978-9066-7de50f0ca9a5 for instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a on hv-cinder-84460 Jun 21 18:35:00.407950 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-186de630-53d5-4b08-8932-252804e657cd req-21efca69-5d91-4b84-af20-d88e9923f409 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033858 Jun 21 18:35:00.408948 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 259/529] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:35:00.641913 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6229dc7f-a874-4c5b-96da-91151fad646a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:00.642777 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6229dc7f-a874-4c5b-96da-91151fad646a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:00.653781 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6229dc7f-a874-4c5b-96da-91151fad646a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:00.654410 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6229dc7f-a874-4c5b-96da-91151fad646a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:00.655676 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6229dc7f-a874-4c5b-96da-91151fad646a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:00.657438 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6229dc7f-a874-4c5b-96da-91151fad646a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:00.878908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-6229dc7f-a874-4c5b-96da-91151fad646a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:00.889827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6229dc7f-a874-4c5b-96da-91151fad646a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1713 microversion: 2.1 time: 0.252265 Jun 21 18:35:00.890490 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 271/530] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:00 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1713 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:08.855880 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2120fc31-b9af-414a-9d71-4a48f8ca644c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:08.857686 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-2120fc31-b9af-414a-9d71-4a48f8ca644c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:08.870874 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2120fc31-b9af-414a-9d71-4a48f8ca644c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:08.872080 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2120fc31-b9af-414a-9d71-4a48f8ca644c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:08.873914 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2120fc31-b9af-414a-9d71-4a48f8ca644c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:08.875036 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2120fc31-b9af-414a-9d71-4a48f8ca644c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:09.029454 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.objects.instance [None req-2120fc31-b9af-414a-9d71-4a48f8ca644c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lazy-loading 'services' on Instance uuid ab23aada-50d7-4852-9624-751aaf33ea8c {{(pid=118108) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:35:09.158370 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2120fc31-b9af-414a-9d71-4a48f8ca644c tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c/os-volume_attachments/7b6abb82-841b-4e15-a45e-30c704ea313c" status: 202 len: 0 microversion: 2.1 time: 0.310035 Jun 21 18:35:09.159396 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 260/531] 10.222.0.87 () {58 vars in 1415 bytes} [Tue Jun 21 18:35:08 2022] DELETE /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c/os-volume_attachments/7b6abb82-841b-4e15-a45e-30c704ea313c => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:35:11.486035 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-3b07a5f5-f21c-44e9-ba77-05a34bbc7a59 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:11.488053 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-3b07a5f5-f21c-44e9-ba77-05a34bbc7a59 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:11.492912 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=45 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:11.494266 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:11.502931 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3b07a5f5-f21c-44e9-ba77-05a34bbc7a59 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:11.503762 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3b07a5f5-f21c-44e9-ba77-05a34bbc7a59 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:11.504876 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3b07a5f5-f21c-44e9-ba77-05a34bbc7a59 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:11.505336 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3b07a5f5-f21c-44e9-ba77-05a34bbc7a59 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:11.544641 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-3b07a5f5-f21c-44e9-ba77-05a34bbc7a59 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Going to try to terminate instance {{(pid=118109) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:35:11.696317 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-3b07a5f5-f21c-44e9-ba77-05a34bbc7a59 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "DELETE /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c" status: 204 len: 0 microversion: 2.1 time: 0.217247 Jun 21 18:35:11.698358 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 272/532] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:35:11 2022] DELETE /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:35:11.716943 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e0ecc9b9-df19-47f3-9143-8fb35ab2d13d tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:11.718320 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e0ecc9b9-df19-47f3-9143-8fb35ab2d13d tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:11.731828 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=38 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:11.735041 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e0ecc9b9-df19-47f3-9143-8fb35ab2d13d tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:11.736698 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e0ecc9b9-df19-47f3-9143-8fb35ab2d13d tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:11.740207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e0ecc9b9-df19-47f3-9143-8fb35ab2d13d tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:11.740985 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e0ecc9b9-df19-47f3-9143-8fb35ab2d13d tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:12.148631 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e0ecc9b9-df19-47f3-9143-8fb35ab2d13d tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:12.169066 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e0ecc9b9-df19-47f3-9143-8fb35ab2d13d tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c" status: 200 len: 1512 microversion: 2.1 time: 0.461155 Jun 21 18:35:12.170561 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 261/533] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:11 2022] GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c => generated 1512 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:13.201382 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-efbc82ed-6544-4995-aebf-957602e9be58 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:13.203736 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-efbc82ed-6544-4995-aebf-957602e9be58 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:13.216296 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-efbc82ed-6544-4995-aebf-957602e9be58 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:13.217102 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-efbc82ed-6544-4995-aebf-957602e9be58 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:13.218859 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-efbc82ed-6544-4995-aebf-957602e9be58 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:13.220245 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-efbc82ed-6544-4995-aebf-957602e9be58 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:13.566237 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-efbc82ed-6544-4995-aebf-957602e9be58 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:13.582084 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-efbc82ed-6544-4995-aebf-957602e9be58 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c" status: 200 len: 1512 microversion: 2.1 time: 0.389394 Jun 21 18:35:13.595170 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 273/534] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:13 2022] GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c => generated 1512 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:14.608920 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e4a91310-eb28-44c5-986a-286d65f34e66 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:14.609577 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e4a91310-eb28-44c5-986a-286d65f34e66 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:14.622776 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e4a91310-eb28-44c5-986a-286d65f34e66 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:14.623526 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e4a91310-eb28-44c5-986a-286d65f34e66 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:14.624660 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e4a91310-eb28-44c5-986a-286d65f34e66 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:14.625265 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e4a91310-eb28-44c5-986a-286d65f34e66 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:14.838571 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e4a91310-eb28-44c5-986a-286d65f34e66 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec179985fc3b41d188ca69d9e03263d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c4efeea2f54994b6f45b5cc346c43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:14.848194 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-618cba70-a3a7-4d18-910a-16b858d6a2b3 req-1c08368e-3594-469c-88cc-ac920c9afd3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab23aada-50d7-4852-9624-751aaf33ea8c", "name": "network-vif-deleted", "tag": "1c6785aa-db33-4621-a2f7-f66bb1b814e9"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:35:14.854918 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e4a91310-eb28-44c5-986a-286d65f34e66 tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c" status: 200 len: 1470 microversion: 2.1 time: 0.250787 Jun 21 18:35:14.857444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 262/535] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:14 2022] GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c => generated 1470 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:14.888634 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-618cba70-a3a7-4d18-910a-16b858d6a2b3 req-1c08368e-3594-469c-88cc-ac920c9afd3a service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:14.889199 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-618cba70-a3a7-4d18-910a-16b858d6a2b3 req-1c08368e-3594-469c-88cc-ac920c9afd3a service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:14.906870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-618cba70-a3a7-4d18-910a-16b858d6a2b3 req-1c08368e-3594-469c-88cc-ac920c9afd3a service nova] Creating event network-vif-deleted:1c6785aa-db33-4621-a2f7-f66bb1b814e9 for instance ab23aada-50d7-4852-9624-751aaf33ea8c on hv-cinder-84460 Jun 21 18:35:14.915874 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-618cba70-a3a7-4d18-910a-16b858d6a2b3 req-1c08368e-3594-469c-88cc-ac920c9afd3a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077379 Jun 21 18:35:14.918283 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 274/536] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:35:15.881610 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c3d5209a-1768-4a26-9af2-b3ed0cdcd4df tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:15.882507 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c3d5209a-1768-4a26-9af2-b3ed0cdcd4df tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] [instance: ab23aada-50d7-4852-9624-751aaf33ea8c] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:15.892903 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c3d5209a-1768-4a26-9af2-b3ed0cdcd4df tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:15.893837 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c3d5209a-1768-4a26-9af2-b3ed0cdcd4df tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:15.894807 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c3d5209a-1768-4a26-9af2-b3ed0cdcd4df tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:15.895243 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c3d5209a-1768-4a26-9af2-b3ed0cdcd4df tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:15.917449 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-c3d5209a-1768-4a26-9af2-b3ed0cdcd4df tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] HTTP exception thrown: Instance ab23aada-50d7-4852-9624-751aaf33ea8c could not be found. Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c3d5209a-1768-4a26-9af2-b3ed0cdcd4df tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Request method failure captured: Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c HTTP/1.1 Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABisg5xx-haiQAHmNsYeom5G3Ju1RvpdC4RxiNK-2Hvjcd5DS4--G6sc_QjSn7h728NVPV3AoavJR7DIQ6gXMkRoyVKnqTrLW310gxw20Vk7Wmpc1F65lwk99Ey539Iuc8eRcAZeP-fWRSQW3iNup07V41Nc0j46kWS7OcGcMuinKUgS20 Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 55c4efeea2f54994b6f45b5cc346c43b Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-VolumesSnapshotTestJSON-408844021 Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:35:15.920619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:35:15.926915 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/55c4efeea2f54994b6f45b5cc346c43b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/55c4efeea2f54994b6f45b5cc346c43b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/55c4efeea2f54994b6f45b5cc346c43b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_55c4efeea2f54994b6f45b5cc346c43b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:35:15.926915 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-VolumesSnapshotTestJSON-408844021 Jun 21 18:35:15.926915 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 55c4efeea2f54994b6f45b5cc346c43b Jun 21 18:35:15.926915 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-408844021 Jun 21 18:35:15.926915 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-VolumesSnapshotTestJSON-408844021-project Jun 21 18:35:15.926915 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:35:15.926915 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:35:15.926915 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: ec179985fc3b41d188ca69d9e03263d0 Jun 21 18:35:15.926915 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-VolumesSnapshotTestJSON-408844021-project Jun 21 18:35:15.926915 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:35:15.926915 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance ab23aada-50d7-4852-9624-751aaf33ea8c could not be found. Jun 21 18:35:15.926915 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': 'ab23aada-50d7-4852-9624-751aaf33ea8c'} Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab23aada-50d7-4852-9624-751aaf33ea8c could not be found. Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:35:15.927707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:35:15.929374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:35:15.929374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:35:15.929374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:35:15.929374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:35:15.929374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:35:15.929374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:35:15.929374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:35:15.929374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab23aada-50d7-4852-9624-751aaf33ea8c could not be found. Jun 21 18:35:15.929374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:35:15.929374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:35:15.929374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:35:15.929374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:35:15.929374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:35:15.929374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:35:15.929374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:35:15.929374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:35:15.929374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab23aada-50d7-4852-9624-751aaf33ea8c could not be found. Jun 21 18:35:15.929374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:35:15.930549 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c3d5209a-1768-4a26-9af2-b3ed0cdcd4df tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] Returning 404 to user: Instance ab23aada-50d7-4852-9624-751aaf33ea8c could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:35:15.930549 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c3d5209a-1768-4a26-9af2-b3ed0cdcd4df tempest-VolumesSnapshotTestJSON-408844021 tempest-VolumesSnapshotTestJSON-408844021-project] 10.222.0.87 "GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c" status: 404 len: 111 microversion: 2.1 time: 0.046756 Jun 21 18:35:15.930549 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 263/537] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:15 2022] GET /compute/v2.1/servers/ab23aada-50d7-4852-9624-751aaf33ea8c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:35:20.234044 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:35:20.238093 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Tue Jun 21 18:35:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:35:34.755291 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-0cb57ddc-bf0f-45d6-ada3-ffd9b7ebd9c0 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Action: 'create', calling method: .version_select at 0x7fd8b80e4310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1290070238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXZv+CwvMhkzOjy81D/O7ImDY6kVJ9R8Hy0aBfdD06BKGq9Zm2I/yEl3ux/GMyn6DEMPW0E8TUtb3F9XdyG7Of14PjLpuAh7xvJrJclcMm/mjKgcqmHfmzZINaDDSEmmw=="}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:35:34.759854 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:34.760495 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:34.780770 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-0cb57ddc-bf0f-45d6-ada3-ffd9b7ebd9c0 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Getting quotas for project b466c8d09c724e26a0883bd5315593c9. Resources: {'key_pairs'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:35:34.785921 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-0cb57ddc-bf0f-45d6-ada3-ffd9b7ebd9c0 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Getting quotas for user 7220499985644eb3804911f12c018b88 and project b466c8d09c724e26a0883bd5315593c9. Resources: {'key_pairs'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:35:34.822607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-0cb57ddc-bf0f-45d6-ada3-ffd9b7ebd9c0 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.071703 Jun 21 18:35:34.823232 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 275/538] 10.222.0.87 () {60 vars in 1158 bytes} [Tue Jun 21 18:35:34 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:35:34.884316 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4681998b-b6c6-4349-a1d3-4c177e39f722 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-91992894", "imageRef": "aaa1e5db-5f04-48c7-a89d-b8c4c86c2ba5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1290070238", "networks": [{"uuid": "0dd37ef8-d5b7-444b-af57-c9fe9d9af29b"}]}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:35:34.893028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=5 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:34.894271 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:34.961852 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.network.neutron [None req-4681998b-b6c6-4349-a1d3-4c177e39f722 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] validate_networks() for [('0dd37ef8-d5b7-444b-af57-c9fe9d9af29b', None, None, None, None, None)] {{(pid=118108) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:35:35.515395 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-4681998b-b6c6-4349-a1d3-4c177e39f722 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Flavor limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:35:35.515982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-4681998b-b6c6-4349-a1d3-4c177e39f722 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Image limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:35:35.516568 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-4681998b-b6c6-4349-a1d3-4c177e39f722 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Flavor pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:35:35.517035 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-4681998b-b6c6-4349-a1d3-4c177e39f722 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Image pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:35:35.517485 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-4681998b-b6c6-4349-a1d3-4c177e39f722 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:35:35.527810 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4681998b-b6c6-4349-a1d3-4c177e39f722 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:35.528261 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4681998b-b6c6-4349-a1d3-4c177e39f722 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:35.529084 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4681998b-b6c6-4349-a1d3-4c177e39f722 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:35.529518 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4681998b-b6c6-4349-a1d3-4c177e39f722 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:35.548835 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-4681998b-b6c6-4349-a1d3-4c177e39f722 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Getting quotas for project b466c8d09c724e26a0883bd5315593c9. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:35:35.554657 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-4681998b-b6c6-4349-a1d3-4c177e39f722 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Getting quotas for user 7220499985644eb3804911f12c018b88 and project b466c8d09c724e26a0883bd5315593c9. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:35:35.570148 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4681998b-b6c6-4349-a1d3-4c177e39f722 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Going to run 1 instances... {{(pid=118108) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:35:35.572914 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4681998b-b6c6-4349-a1d3-4c177e39f722 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aaa1e5db-5f04-48c7-a89d-b8c4c86c2ba5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118108) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:35:35.624470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4681998b-b6c6-4349-a1d3-4c177e39f722 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745129 Jun 21 18:35:35.625120 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 264/539] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:35:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 18:35:35.636425 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-aed14770-882a-4ba9-a39a-732f7a3d9628 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:35.637197 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-aed14770-882a-4ba9-a39a-732f7a3d9628 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:35.721852 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-aed14770-882a-4ba9-a39a-732f7a3d9628 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:35.730905 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-aed14770-882a-4ba9-a39a-732f7a3d9628 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1257 microversion: 2.1 time: 0.098492 Jun 21 18:35:35.731688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 276/540] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:35 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1257 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:35:36.752323 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-3716a2ea-b1c2-4ba8-b3cd-436d5247c5b8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:36.753088 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-3716a2ea-b1c2-4ba8-b3cd-436d5247c5b8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:36.761005 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3716a2ea-b1c2-4ba8-b3cd-436d5247c5b8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:36.761474 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3716a2ea-b1c2-4ba8-b3cd-436d5247c5b8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:36.762289 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3716a2ea-b1c2-4ba8-b3cd-436d5247c5b8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:36.768793 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3716a2ea-b1c2-4ba8-b3cd-436d5247c5b8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:36.865172 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-3716a2ea-b1c2-4ba8-b3cd-436d5247c5b8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:36.877543 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-3716a2ea-b1c2-4ba8-b3cd-436d5247c5b8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1309 microversion: 2.1 time: 0.129166 Jun 21 18:35:36.878350 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 265/541] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:36 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1309 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:37.913101 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-216ac64d-2aa0-4861-aa9f-2f1db4731f85 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:37.914256 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-216ac64d-2aa0-4861-aa9f-2f1db4731f85 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:37.970698 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-216ac64d-2aa0-4861-aa9f-2f1db4731f85 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:37.971698 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-216ac64d-2aa0-4861-aa9f-2f1db4731f85 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:37.973156 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-216ac64d-2aa0-4861-aa9f-2f1db4731f85 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:37.973602 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-216ac64d-2aa0-4861-aa9f-2f1db4731f85 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:38.458322 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-216ac64d-2aa0-4861-aa9f-2f1db4731f85 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:38.489109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-216ac64d-2aa0-4861-aa9f-2f1db4731f85 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1357 microversion: 2.1 time: 0.587091 Jun 21 18:35:38.490568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 277/542] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:37 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1357 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:39.516651 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-9564c2ae-0a40-4b47-91f3-2adf6c818899 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:39.517787 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-9564c2ae-0a40-4b47-91f3-2adf6c818899 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:39.540228 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9564c2ae-0a40-4b47-91f3-2adf6c818899 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:39.540906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9564c2ae-0a40-4b47-91f3-2adf6c818899 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:39.543459 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9564c2ae-0a40-4b47-91f3-2adf6c818899 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:39.544209 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9564c2ae-0a40-4b47-91f3-2adf6c818899 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:39.759817 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-9564c2ae-0a40-4b47-91f3-2adf6c818899 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:39.769181 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-9564c2ae-0a40-4b47-91f3-2adf6c818899 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1357 microversion: 2.1 time: 0.260671 Jun 21 18:35:39.770070 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 266/543] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:39 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1357 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:40.793543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-5a009f5b-7d4a-4755-a08a-799eac8ca078 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:40.794835 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-5a009f5b-7d4a-4755-a08a-799eac8ca078 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:40.808051 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5a009f5b-7d4a-4755-a08a-799eac8ca078 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:40.808912 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5a009f5b-7d4a-4755-a08a-799eac8ca078 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:40.810869 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5a009f5b-7d4a-4755-a08a-799eac8ca078 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:40.812040 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5a009f5b-7d4a-4755-a08a-799eac8ca078 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:41.077413 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-5a009f5b-7d4a-4755-a08a-799eac8ca078 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:41.090852 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-5a009f5b-7d4a-4755-a08a-799eac8ca078 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1357 microversion: 2.1 time: 0.305239 Jun 21 18:35:41.091876 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 278/544] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:40 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1357 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:42.114607 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e982efc0-ebc3-47cd-987f-bbbbd326f2f4 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:42.115701 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e982efc0-ebc3-47cd-987f-bbbbd326f2f4 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:42.125293 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e982efc0-ebc3-47cd-987f-bbbbd326f2f4 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:42.125997 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e982efc0-ebc3-47cd-987f-bbbbd326f2f4 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:42.127319 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e982efc0-ebc3-47cd-987f-bbbbd326f2f4 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:42.127922 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e982efc0-ebc3-47cd-987f-bbbbd326f2f4 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:42.366101 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e982efc0-ebc3-47cd-987f-bbbbd326f2f4 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:42.379483 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e982efc0-ebc3-47cd-987f-bbbbd326f2f4 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1357 microversion: 2.1 time: 0.270717 Jun 21 18:35:42.380936 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 267/545] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:42 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1357 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:43.409040 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ccd83343-d025-4b5f-baf7-3b7682008f26 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:43.410050 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ccd83343-d025-4b5f-baf7-3b7682008f26 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:43.417799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ccd83343-d025-4b5f-baf7-3b7682008f26 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:43.418181 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ccd83343-d025-4b5f-baf7-3b7682008f26 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:43.418981 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ccd83343-d025-4b5f-baf7-3b7682008f26 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:43.419420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ccd83343-d025-4b5f-baf7-3b7682008f26 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:43.583823 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ccd83343-d025-4b5f-baf7-3b7682008f26 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:43.597179 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ccd83343-d025-4b5f-baf7-3b7682008f26 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1357 microversion: 2.1 time: 0.195126 Jun 21 18:35:43.598265 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 279/546] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:43 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:35:44.633814 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-36faa676-6d37-4d93-a916-dea5646fb59b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:44.634975 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-36faa676-6d37-4d93-a916-dea5646fb59b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:44.645599 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-36faa676-6d37-4d93-a916-dea5646fb59b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:44.646417 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-36faa676-6d37-4d93-a916-dea5646fb59b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:44.648071 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-36faa676-6d37-4d93-a916-dea5646fb59b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:44.649124 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-36faa676-6d37-4d93-a916-dea5646fb59b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:44.888378 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-36faa676-6d37-4d93-a916-dea5646fb59b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:44.904704 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-36faa676-6d37-4d93-a916-dea5646fb59b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1357 microversion: 2.1 time: 0.279432 Jun 21 18:35:44.905885 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 268/547] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:44 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1357 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:45.934999 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-7c541edd-a358-477a-b903-9fb69634c26c tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:45.938246 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-7c541edd-a358-477a-b903-9fb69634c26c tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:45.952898 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=6 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:45.960626 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7c541edd-a358-477a-b903-9fb69634c26c tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:45.961865 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7c541edd-a358-477a-b903-9fb69634c26c tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:45.963462 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7c541edd-a358-477a-b903-9fb69634c26c tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:45.964311 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7c541edd-a358-477a-b903-9fb69634c26c tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:46.240685 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-7c541edd-a358-477a-b903-9fb69634c26c tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:46.256611 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-7c541edd-a358-477a-b903-9fb69634c26c tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1357 microversion: 2.1 time: 0.330295 Jun 21 18:35:46.275152 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 280/548] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:45 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1357 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:47.287869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-673d1b30-6c49-4c09-b792-e3c705217a7a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:47.289090 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-673d1b30-6c49-4c09-b792-e3c705217a7a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:47.317080 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=2 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:47.319134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=6 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:35:47.326314 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-673d1b30-6c49-4c09-b792-e3c705217a7a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:47.327015 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-673d1b30-6c49-4c09-b792-e3c705217a7a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:47.328683 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-673d1b30-6c49-4c09-b792-e3c705217a7a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:47.329560 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-673d1b30-6c49-4c09-b792-e3c705217a7a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:48.173473 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-673d1b30-6c49-4c09-b792-e3c705217a7a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:48.189271 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-673d1b30-6c49-4c09-b792-e3c705217a7a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1357 microversion: 2.1 time: 0.909072 Jun 21 18:35:48.190386 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 269/549] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:47 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1357 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:49.219566 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2c645eca-4440-41eb-880c-fc0efbe215d6 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:49.220737 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-2c645eca-4440-41eb-880c-fc0efbe215d6 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:49.232463 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2c645eca-4440-41eb-880c-fc0efbe215d6 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:49.233296 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2c645eca-4440-41eb-880c-fc0efbe215d6 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:49.234757 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2c645eca-4440-41eb-880c-fc0efbe215d6 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:49.235581 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2c645eca-4440-41eb-880c-fc0efbe215d6 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:49.497151 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2c645eca-4440-41eb-880c-fc0efbe215d6 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:49.511825 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-2c645eca-4440-41eb-880c-fc0efbe215d6 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1357 microversion: 2.1 time: 0.300088 Jun 21 18:35:49.512949 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 281/550] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:49 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1357 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:49.675080 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c1a80ca0-274a-4d9f-aa03-549e0466b5d4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a3192c1-8650-4f6a-afd5-2bd25f3ca609"}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:35:49.676680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c1a80ca0-274a-4d9f-aa03-549e0466b5d4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:49.683911 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c1a80ca0-274a-4d9f-aa03-549e0466b5d4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:49.684432 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c1a80ca0-274a-4d9f-aa03-549e0466b5d4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:49.685269 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c1a80ca0-274a-4d9f-aa03-549e0466b5d4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:49.685890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c1a80ca0-274a-4d9f-aa03-549e0466b5d4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:50.543224 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-da2df11a-a378-44d3-94f6-1108c4c38d90 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:50.544373 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-da2df11a-a378-44d3-94f6-1108c4c38d90 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:50.558276 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-da2df11a-a378-44d3-94f6-1108c4c38d90 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:50.559097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-da2df11a-a378-44d3-94f6-1108c4c38d90 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:50.560616 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-da2df11a-a378-44d3-94f6-1108c4c38d90 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:50.561428 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-da2df11a-a378-44d3-94f6-1108c4c38d90 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:50.775720 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-da2df11a-a378-44d3-94f6-1108c4c38d90 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:50.787259 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-da2df11a-a378-44d3-94f6-1108c4c38d90 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1357 microversion: 2.1 time: 0.251520 Jun 21 18:35:50.788281 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 282/551] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:50 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1357 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:35:51.820013 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-39f45b77-1ed1-4490-9b8a-f40b854502c5 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:51.822719 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-39f45b77-1ed1-4490-9b8a-f40b854502c5 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:51.831902 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-39f45b77-1ed1-4490-9b8a-f40b854502c5 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:51.832451 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-39f45b77-1ed1-4490-9b8a-f40b854502c5 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:51.833360 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-39f45b77-1ed1-4490-9b8a-f40b854502c5 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:51.833903 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-39f45b77-1ed1-4490-9b8a-f40b854502c5 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:52.082777 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c1a80ca0-274a-4d9f-aa03-549e0466b5d4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "POST /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.804611 Jun 21 18:35:52.090340 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 270/552] 10.222.0.87 () {60 vars in 1322 bytes} [Tue Jun 21 18:35:49 2022] POST /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/os-volume_attachments => generated 194 bytes in 2808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:35:52.174134 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-39f45b77-1ed1-4490-9b8a-f40b854502c5 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:52.183774 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-39f45b77-1ed1-4490-9b8a-f40b854502c5 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1357 microversion: 2.1 time: 0.373257 Jun 21 18:35:52.185376 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 283/553] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:51 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1357 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:35:53.012385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-8f19c827-d911-48a0-9599-2c76e40b262e req-b0d88bb8-fc75-4af8-b32c-d475a912594f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35920613-c14d-4e14-8d6d-bb7b8aad3580", "tag": "1726067c-21f2-4c33-a050-983a29ae5f04"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:35:53.023574 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-8f19c827-d911-48a0-9599-2c76e40b262e req-b0d88bb8-fc75-4af8-b32c-d475a912594f service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:53.024028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-8f19c827-d911-48a0-9599-2c76e40b262e req-b0d88bb8-fc75-4af8-b32c-d475a912594f service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:53.045546 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-8f19c827-d911-48a0-9599-2c76e40b262e req-b0d88bb8-fc75-4af8-b32c-d475a912594f service nova] Creating event network-changed:1726067c-21f2-4c33-a050-983a29ae5f04 for instance 35920613-c14d-4e14-8d6d-bb7b8aad3580 on hv-cinder-84460 Jun 21 18:35:53.052651 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-8f19c827-d911-48a0-9599-2c76e40b262e req-b0d88bb8-fc75-4af8-b32c-d475a912594f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219255 Jun 21 18:35:53.054390 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 271/554] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:35:53.221989 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b9a33e19-b145-4b6d-9bf0-863c5c97e641 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:53.221989 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b9a33e19-b145-4b6d-9bf0-863c5c97e641 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:53.249615 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b9a33e19-b145-4b6d-9bf0-863c5c97e641 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:53.251055 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b9a33e19-b145-4b6d-9bf0-863c5c97e641 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:53.252734 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b9a33e19-b145-4b6d-9bf0-863c5c97e641 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:53.253927 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b9a33e19-b145-4b6d-9bf0-863c5c97e641 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:53.591125 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b9a33e19-b145-4b6d-9bf0-863c5c97e641 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:53.600880 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b9a33e19-b145-4b6d-9bf0-863c5c97e641 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1357 microversion: 2.1 time: 0.402358 Jun 21 18:35:53.604616 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 284/555] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:53 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1357 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:54.620237 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f67ef10e-65cd-41b6-a9e5-3f128002d01f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:54.621251 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f67ef10e-65cd-41b6-a9e5-3f128002d01f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:54.632265 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f67ef10e-65cd-41b6-a9e5-3f128002d01f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:54.633046 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f67ef10e-65cd-41b6-a9e5-3f128002d01f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:54.634538 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f67ef10e-65cd-41b6-a9e5-3f128002d01f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:54.635340 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f67ef10e-65cd-41b6-a9e5-3f128002d01f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:54.817325 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f67ef10e-65cd-41b6-a9e5-3f128002d01f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:54.831670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f67ef10e-65cd-41b6-a9e5-3f128002d01f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1357 microversion: 2.1 time: 0.215466 Jun 21 18:35:54.832723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 272/556] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:54 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:55.859079 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-27797ede-296e-4ea5-ae9a-92d8078a8fb4 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:55.860301 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-27797ede-296e-4ea5-ae9a-92d8078a8fb4 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:55.874425 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-27797ede-296e-4ea5-ae9a-92d8078a8fb4 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:55.875792 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-27797ede-296e-4ea5-ae9a-92d8078a8fb4 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:55.877306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-27797ede-296e-4ea5-ae9a-92d8078a8fb4 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:55.878094 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-27797ede-296e-4ea5-ae9a-92d8078a8fb4 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:56.103277 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-27797ede-296e-4ea5-ae9a-92d8078a8fb4 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:56.113727 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-27797ede-296e-4ea5-ae9a-92d8078a8fb4 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1357 microversion: 2.1 time: 0.260489 Jun 21 18:35:56.114788 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 285/557] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:55 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1357 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:57.143940 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-213544a2-f720-4beb-8c94-ca2dee635e14 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:57.146176 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-213544a2-f720-4beb-8c94-ca2dee635e14 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:57.153608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-213544a2-f720-4beb-8c94-ca2dee635e14 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:57.154177 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-213544a2-f720-4beb-8c94-ca2dee635e14 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:57.155043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-213544a2-f720-4beb-8c94-ca2dee635e14 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:57.155575 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-213544a2-f720-4beb-8c94-ca2dee635e14 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:57.407047 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-213544a2-f720-4beb-8c94-ca2dee635e14 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:57.419099 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-213544a2-f720-4beb-8c94-ca2dee635e14 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1357 microversion: 2.1 time: 0.283081 Jun 21 18:35:57.420183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 273/558] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:57 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1357 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:35:58.447293 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c5ccd812-82d2-436b-a5e1-3a7c73a618bf tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:58.448270 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c5ccd812-82d2-436b-a5e1-3a7c73a618bf tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:58.457199 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c5ccd812-82d2-436b-a5e1-3a7c73a618bf tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:58.457787 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c5ccd812-82d2-436b-a5e1-3a7c73a618bf tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:58.459014 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c5ccd812-82d2-436b-a5e1-3a7c73a618bf tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:58.459683 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c5ccd812-82d2-436b-a5e1-3a7c73a618bf tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:58.653298 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c5ccd812-82d2-436b-a5e1-3a7c73a618bf tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:58.662437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c5ccd812-82d2-436b-a5e1-3a7c73a618bf tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1357 microversion: 2.1 time: 0.221188 Jun 21 18:35:58.663022 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 286/559] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:58 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:59.689111 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-163916ad-5603-473f-9c8d-1765a3ed9b50 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:35:59.690506 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-163916ad-5603-473f-9c8d-1765a3ed9b50 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:59.698604 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-163916ad-5603-473f-9c8d-1765a3ed9b50 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:59.699134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-163916ad-5603-473f-9c8d-1765a3ed9b50 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:59.700069 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-163916ad-5603-473f-9c8d-1765a3ed9b50 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:59.700571 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-163916ad-5603-473f-9c8d-1765a3ed9b50 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:59.898910 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-aff22fca-ba0b-44cb-a717-df4291dadaa7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:35:59.900626 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-aff22fca-ba0b-44cb-a717-df4291dadaa7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:35:59.913262 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aff22fca-ba0b-44cb-a717-df4291dadaa7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:59.914030 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aff22fca-ba0b-44cb-a717-df4291dadaa7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:59.915234 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aff22fca-ba0b-44cb-a717-df4291dadaa7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:35:59.915449 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-163916ad-5603-473f-9c8d-1765a3ed9b50 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:35:59.915948 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aff22fca-ba0b-44cb-a717-df4291dadaa7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:35:59.924707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-163916ad-5603-473f-9c8d-1765a3ed9b50 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1357 microversion: 2.1 time: 0.240019 Jun 21 18:35:59.925308 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 274/560] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:35:59 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:35:59.948610 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.objects.instance [None req-aff22fca-ba0b-44cb-a717-df4291dadaa7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lazy-loading 'flavor' on Instance uuid 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc {{(pid=118109) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:36:00.175319 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-aff22fca-ba0b-44cb-a717-df4291dadaa7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "POST /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/action" status: 200 len: 32 microversion: 2.1 time: 0.284132 Jun 21 18:36:00.176289 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 287/561] 10.222.0.87 () {60 vars in 1277 bytes} [Tue Jun 21 18:35:59 2022] POST /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/action => generated 32 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 18:36:00.192133 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6bd6ea8f-8175-4e71-9212-138be194960e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:00.193253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-6bd6ea8f-8175-4e71-9212-138be194960e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:00.204009 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6bd6ea8f-8175-4e71-9212-138be194960e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:00.204704 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6bd6ea8f-8175-4e71-9212-138be194960e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:00.205962 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6bd6ea8f-8175-4e71-9212-138be194960e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:00.206690 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6bd6ea8f-8175-4e71-9212-138be194960e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:00.548939 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6bd6ea8f-8175-4e71-9212-138be194960e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:00.565498 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6bd6ea8f-8175-4e71-9212-138be194960e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1736 microversion: 2.1 time: 0.380553 Jun 21 18:36:00.566426 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 275/562] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:00 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1736 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:00.697507 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-bb4dde05-abf1-42f3-8c6a-06e213eae405 req-c4195ff5-3a07-4cb2-9d36-ae4a817d3f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35920613-c14d-4e14-8d6d-bb7b8aad3580", "name": "network-vif-plugged", "status": "completed", "tag": "1726067c-21f2-4c33-a050-983a29ae5f04"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:00.714185 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-bb4dde05-abf1-42f3-8c6a-06e213eae405 req-c4195ff5-3a07-4cb2-9d36-ae4a817d3f1c service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:00.715001 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-bb4dde05-abf1-42f3-8c6a-06e213eae405 req-c4195ff5-3a07-4cb2-9d36-ae4a817d3f1c service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:00.738132 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-bb4dde05-abf1-42f3-8c6a-06e213eae405 req-c4195ff5-3a07-4cb2-9d36-ae4a817d3f1c service nova] Creating event network-vif-plugged:1726067c-21f2-4c33-a050-983a29ae5f04 for instance 35920613-c14d-4e14-8d6d-bb7b8aad3580 on hv-cinder-84460 Jun 21 18:36:00.748021 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-bb4dde05-abf1-42f3-8c6a-06e213eae405 req-c4195ff5-3a07-4cb2-9d36-ae4a817d3f1c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170113 Jun 21 18:36:00.749073 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 288/563] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:36:00.951089 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5de4669a-4839-4172-a8dd-9748bbb33f35 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:00.952454 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-5de4669a-4839-4172-a8dd-9748bbb33f35 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:00.967129 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5de4669a-4839-4172-a8dd-9748bbb33f35 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:00.968095 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5de4669a-4839-4172-a8dd-9748bbb33f35 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:00.969826 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5de4669a-4839-4172-a8dd-9748bbb33f35 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:00.970740 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5de4669a-4839-4172-a8dd-9748bbb33f35 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:01.301603 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-5de4669a-4839-4172-a8dd-9748bbb33f35 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:01.315309 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-5de4669a-4839-4172-a8dd-9748bbb33f35 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1357 microversion: 2.1 time: 0.374102 Jun 21 18:36:01.316330 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 276/564] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:00 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1357 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:01.599359 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-7a89fbf5-82e8-459d-a32c-dcb809d8ae57 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:01.600658 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-7a89fbf5-82e8-459d-a32c-dcb809d8ae57 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:01.612749 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7a89fbf5-82e8-459d-a32c-dcb809d8ae57 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:01.613371 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7a89fbf5-82e8-459d-a32c-dcb809d8ae57 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:01.614557 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7a89fbf5-82e8-459d-a32c-dcb809d8ae57 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:01.615300 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7a89fbf5-82e8-459d-a32c-dcb809d8ae57 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:01.786262 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-7a89fbf5-82e8-459d-a32c-dcb809d8ae57 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:01.795257 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-7a89fbf5-82e8-459d-a32c-dcb809d8ae57 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1736 microversion: 2.1 time: 0.206601 Jun 21 18:36:01.795856 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 289/565] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:01 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1736 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:02.346953 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d733d8d2-16bf-4b97-8974-1f2d1bc5c3f1 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:02.348874 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-d733d8d2-16bf-4b97-8974-1f2d1bc5c3f1 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:02.356022 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d733d8d2-16bf-4b97-8974-1f2d1bc5c3f1 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:02.356789 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d733d8d2-16bf-4b97-8974-1f2d1bc5c3f1 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:02.357839 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d733d8d2-16bf-4b97-8974-1f2d1bc5c3f1 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:02.358244 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d733d8d2-16bf-4b97-8974-1f2d1bc5c3f1 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:02.540633 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-d733d8d2-16bf-4b97-8974-1f2d1bc5c3f1 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:02.549307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-d733d8d2-16bf-4b97-8974-1f2d1bc5c3f1 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1357 microversion: 2.1 time: 0.211169 Jun 21 18:36:02.550171 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 277/566] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:02 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:02.819931 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2c23475d-b3c0-4b04-9a40-574703737203 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:02.821184 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-2c23475d-b3c0-4b04-9a40-574703737203 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:02.831341 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2c23475d-b3c0-4b04-9a40-574703737203 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:02.831784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2c23475d-b3c0-4b04-9a40-574703737203 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:02.832568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2c23475d-b3c0-4b04-9a40-574703737203 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:02.832995 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2c23475d-b3c0-4b04-9a40-574703737203 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:03.044728 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2c23475d-b3c0-4b04-9a40-574703737203 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:03.055390 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-2c23475d-b3c0-4b04-9a40-574703737203 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1736 microversion: 2.1 time: 0.244308 Jun 21 18:36:03.056300 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 290/567] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:02 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:03.572111 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-ffbac8ca-5d2d-4b80-8976-1b1f930aeb06 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:03.572771 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-ffbac8ca-5d2d-4b80-8976-1b1f930aeb06 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:03.581217 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ffbac8ca-5d2d-4b80-8976-1b1f930aeb06 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:03.581999 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ffbac8ca-5d2d-4b80-8976-1b1f930aeb06 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:03.583207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ffbac8ca-5d2d-4b80-8976-1b1f930aeb06 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:03.583789 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ffbac8ca-5d2d-4b80-8976-1b1f930aeb06 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:03.777726 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ffbac8ca-5d2d-4b80-8976-1b1f930aeb06 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:03.790371 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-ffbac8ca-5d2d-4b80-8976-1b1f930aeb06 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1547 microversion: 2.1 time: 0.225796 Jun 21 18:36:03.791221 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 278/568] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:03 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1547 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:03.813358 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-5e84e9a0-6aac-46b4-9de4-eeddb3239525 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:03.814376 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-5e84e9a0-6aac-46b4-9de4-eeddb3239525 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:03.824549 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5e84e9a0-6aac-46b4-9de4-eeddb3239525 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:03.826256 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5e84e9a0-6aac-46b4-9de4-eeddb3239525 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:03.827809 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5e84e9a0-6aac-46b4-9de4-eeddb3239525 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:03.829618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5e84e9a0-6aac-46b4-9de4-eeddb3239525 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:04.016543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-5e84e9a0-6aac-46b4-9de4-eeddb3239525 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:04.027656 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-5e84e9a0-6aac-46b4-9de4-eeddb3239525 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1547 microversion: 2.1 time: 0.219841 Jun 21 18:36:04.028475 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 291/569] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:03 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1547 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:04.052169 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-24f66721-4b09-4f09-babe-196de6a61421 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:04.059387 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-24f66721-4b09-4f09-babe-196de6a61421 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:04.060776 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-24f66721-4b09-4f09-babe-196de6a61421 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Searching by: {'deleted': False, 'project_id': 'b466c8d09c724e26a0883bd5315593c9'} {{(pid=118108) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 21 18:36:04.074020 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-24f66721-4b09-4f09-babe-196de6a61421 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:04.074876 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-24f66721-4b09-4f09-babe-196de6a61421 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:04.076269 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-24f66721-4b09-4f09-babe-196de6a61421 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:04.077052 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-24f66721-4b09-4f09-babe-196de6a61421 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:04.086092 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6fcc34f9-20ef-45c2-86a4-ef6239358751 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:04.087172 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6fcc34f9-20ef-45c2-86a4-ef6239358751 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:04.103196 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6fcc34f9-20ef-45c2-86a4-ef6239358751 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:04.104020 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6fcc34f9-20ef-45c2-86a4-ef6239358751 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:04.105387 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6fcc34f9-20ef-45c2-86a4-ef6239358751 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:04.106256 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6fcc34f9-20ef-45c2-86a4-ef6239358751 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:04.114803 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:04.268533 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.multi_cell_list [None req-24f66721-4b09-4f09-babe-196de6a61421 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118108) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 21 18:36:04.327574 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-6fcc34f9-20ef-45c2-86a4-ef6239358751 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:04.343348 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6fcc34f9-20ef-45c2-86a4-ef6239358751 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1736 microversion: 2.1 time: 0.271393 Jun 21 18:36:04.345166 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 292/570] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:04 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1736 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:04.448924 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-24f66721-4b09-4f09-babe-196de6a61421 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.404233 Jun 21 18:36:04.449921 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 279/571] 10.222.0.87 () {58 vars in 1124 bytes} [Tue Jun 21 18:36:04 2022] GET /compute/v2.1/servers => generated 341 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:36:04.463557 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8b35eff2-5012-4373-8647-b078eafc8467 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:04.464171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8b35eff2-5012-4373-8647-b078eafc8467 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:04.472098 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8b35eff2-5012-4373-8647-b078eafc8467 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:04.472513 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8b35eff2-5012-4373-8647-b078eafc8467 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:04.473305 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8b35eff2-5012-4373-8647-b078eafc8467 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:04.473776 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8b35eff2-5012-4373-8647-b078eafc8467 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:04.686227 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-8b35eff2-5012-4373-8647-b078eafc8467 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:04.696767 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8b35eff2-5012-4373-8647-b078eafc8467 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1547 microversion: 2.1 time: 0.237092 Jun 21 18:36:04.697582 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 293/572] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:04 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1547 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:05.373094 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-83217919-922b-48c9-bf3a-fb2aeb5f5294 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:05.373908 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-83217919-922b-48c9-bf3a-fb2aeb5f5294 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:05.376761 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:05.386436 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-83217919-922b-48c9-bf3a-fb2aeb5f5294 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:05.387285 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-83217919-922b-48c9-bf3a-fb2aeb5f5294 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:05.388531 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-83217919-922b-48c9-bf3a-fb2aeb5f5294 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:05.389115 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-83217919-922b-48c9-bf3a-fb2aeb5f5294 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:05.396458 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:05.589067 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-83217919-922b-48c9-bf3a-fb2aeb5f5294 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:05.605850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-83217919-922b-48c9-bf3a-fb2aeb5f5294 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1736 microversion: 2.1 time: 0.237910 Jun 21 18:36:05.606928 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 280/573] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:05 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1736 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:06.599469 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-7ce4e691-bb53-4ac5-9fb1-ba29d199c540 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f12968c8-48ad-4230-a8ce-0993fa125e3c"}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:06.600912 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-7ce4e691-bb53-4ac5-9fb1-ba29d199c540 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:06.603997 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:06.614755 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7ce4e691-bb53-4ac5-9fb1-ba29d199c540 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:06.615570 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7ce4e691-bb53-4ac5-9fb1-ba29d199c540 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:06.616966 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7ce4e691-bb53-4ac5-9fb1-ba29d199c540 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:06.617796 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7ce4e691-bb53-4ac5-9fb1-ba29d199c540 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:06.629768 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b3536cc5-d11d-4928-9eb8-f0d50773f482 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:06.630738 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b3536cc5-d11d-4928-9eb8-f0d50773f482 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:06.641088 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b3536cc5-d11d-4928-9eb8-f0d50773f482 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:06.641627 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b3536cc5-d11d-4928-9eb8-f0d50773f482 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:06.642494 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b3536cc5-d11d-4928-9eb8-f0d50773f482 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:06.642933 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b3536cc5-d11d-4928-9eb8-f0d50773f482 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:06.846485 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-b3536cc5-d11d-4928-9eb8-f0d50773f482 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:06.858139 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b3536cc5-d11d-4928-9eb8-f0d50773f482 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1736 microversion: 2.1 time: 0.233314 Jun 21 18:36:06.858844 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 281/574] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:06 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1736 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:07.054388 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-7ce4e691-bb53-4ac5-9fb1-ba29d199c540 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "POST /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.459416 Jun 21 18:36:07.055271 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 294/575] 10.222.0.87 () {60 vars in 1322 bytes} [Tue Jun 21 18:36:06 2022] POST /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580/os-volume_attachments => generated 194 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:36:07.881215 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-1ddc2076-8bea-40d2-831b-71ce6c0ffaf4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:07.882273 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-1ddc2076-8bea-40d2-831b-71ce6c0ffaf4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:07.894220 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1ddc2076-8bea-40d2-831b-71ce6c0ffaf4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:07.895120 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1ddc2076-8bea-40d2-831b-71ce6c0ffaf4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:07.896263 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1ddc2076-8bea-40d2-831b-71ce6c0ffaf4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:07.896929 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1ddc2076-8bea-40d2-831b-71ce6c0ffaf4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:08.114840 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-1ddc2076-8bea-40d2-831b-71ce6c0ffaf4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:08.130966 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-1ddc2076-8bea-40d2-831b-71ce6c0ffaf4 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1736 microversion: 2.1 time: 0.256546 Jun 21 18:36:08.132013 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 282/576] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:07 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1736 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:09.164626 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f1b39148-28d5-49d6-9bd2-801f86f79cb2 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:09.165522 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f1b39148-28d5-49d6-9bd2-801f86f79cb2 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:09.172663 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f1b39148-28d5-49d6-9bd2-801f86f79cb2 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:09.173137 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f1b39148-28d5-49d6-9bd2-801f86f79cb2 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:09.174055 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f1b39148-28d5-49d6-9bd2-801f86f79cb2 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:09.174373 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f1b39148-28d5-49d6-9bd2-801f86f79cb2 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:09.371237 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f1b39148-28d5-49d6-9bd2-801f86f79cb2 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:09.380673 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f1b39148-28d5-49d6-9bd2-801f86f79cb2 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1736 microversion: 2.1 time: 0.223241 Jun 21 18:36:09.381290 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 295/577] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:09 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:10.400481 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f258692d-18a4-43cf-9f11-095cbee6a7a5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:10.401485 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f258692d-18a4-43cf-9f11-095cbee6a7a5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:10.410958 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f258692d-18a4-43cf-9f11-095cbee6a7a5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:10.411448 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f258692d-18a4-43cf-9f11-095cbee6a7a5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:10.412441 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f258692d-18a4-43cf-9f11-095cbee6a7a5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:10.412895 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f258692d-18a4-43cf-9f11-095cbee6a7a5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:10.595577 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f258692d-18a4-43cf-9f11-095cbee6a7a5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:10.605872 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f258692d-18a4-43cf-9f11-095cbee6a7a5 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1736 microversion: 2.1 time: 0.209769 Jun 21 18:36:10.606647 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 283/578] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:10 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:11.628005 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-5bbc320f-28be-46b8-8f48-17df33ffd27f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:11.629111 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-5bbc320f-28be-46b8-8f48-17df33ffd27f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:11.640028 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5bbc320f-28be-46b8-8f48-17df33ffd27f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:11.640388 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5bbc320f-28be-46b8-8f48-17df33ffd27f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:11.641672 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5bbc320f-28be-46b8-8f48-17df33ffd27f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:11.642380 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5bbc320f-28be-46b8-8f48-17df33ffd27f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:11.854199 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-5bbc320f-28be-46b8-8f48-17df33ffd27f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:11.865290 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-5bbc320f-28be-46b8-8f48-17df33ffd27f tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1736 microversion: 2.1 time: 0.244178 Jun 21 18:36:11.865928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 296/579] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:11 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:12.889277 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a1d585fe-c905-4970-9205-b0ff4940a655 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:12.890384 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-a1d585fe-c905-4970-9205-b0ff4940a655 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:12.898691 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a1d585fe-c905-4970-9205-b0ff4940a655 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:12.899197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a1d585fe-c905-4970-9205-b0ff4940a655 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:12.900056 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a1d585fe-c905-4970-9205-b0ff4940a655 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:12.900565 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a1d585fe-c905-4970-9205-b0ff4940a655 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:13.110518 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-a1d585fe-c905-4970-9205-b0ff4940a655 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:13.123096 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a1d585fe-c905-4970-9205-b0ff4940a655 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1736 microversion: 2.1 time: 0.238006 Jun 21 18:36:13.123785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 284/580] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:12 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1736 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:14.146081 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1b486e28-1a49-4f67-9a67-671b19281744 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:14.148300 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1b486e28-1a49-4f67-9a67-671b19281744 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:14.161146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b486e28-1a49-4f67-9a67-671b19281744 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:14.161890 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b486e28-1a49-4f67-9a67-671b19281744 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:14.163251 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b486e28-1a49-4f67-9a67-671b19281744 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:14.164010 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b486e28-1a49-4f67-9a67-671b19281744 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:14.391602 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1b486e28-1a49-4f67-9a67-671b19281744 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:14.401698 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1b486e28-1a49-4f67-9a67-671b19281744 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1736 microversion: 2.1 time: 0.262697 Jun 21 18:36:14.402220 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 297/581] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:14 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1736 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:14.906037 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c40834a5-5a45-4ace-b6fe-642981cf8411 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:14.906936 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c40834a5-5a45-4ace-b6fe-642981cf8411 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:14.909382 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=2 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:14.917233 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c40834a5-5a45-4ace-b6fe-642981cf8411 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:14.917575 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c40834a5-5a45-4ace-b6fe-642981cf8411 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:14.918397 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c40834a5-5a45-4ace-b6fe-642981cf8411 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:14.918820 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c40834a5-5a45-4ace-b6fe-642981cf8411 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:15.094919 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c40834a5-5a45-4ace-b6fe-642981cf8411 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:15.107253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c40834a5-5a45-4ace-b6fe-642981cf8411 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1593 microversion: 2.1 time: 0.205070 Jun 21 18:36:15.108022 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 285/582] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:14 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1593 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:15.423947 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-478bcc32-462b-4a4b-9238-e95bf69b6014 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:15.424842 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-478bcc32-462b-4a4b-9238-e95bf69b6014 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:15.433365 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-478bcc32-462b-4a4b-9238-e95bf69b6014 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:15.433985 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-478bcc32-462b-4a4b-9238-e95bf69b6014 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:15.434889 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-478bcc32-462b-4a4b-9238-e95bf69b6014 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:15.435395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-478bcc32-462b-4a4b-9238-e95bf69b6014 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:15.655968 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-478bcc32-462b-4a4b-9238-e95bf69b6014 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:15.672746 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-478bcc32-462b-4a4b-9238-e95bf69b6014 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1736 microversion: 2.1 time: 0.252539 Jun 21 18:36:15.673891 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 298/583] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:15 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1736 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:16.704548 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-9fcb4c4f-c99e-475e-9e18-b3ecefc7ad20 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:16.705759 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-9fcb4c4f-c99e-475e-9e18-b3ecefc7ad20 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:16.719248 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9fcb4c4f-c99e-475e-9e18-b3ecefc7ad20 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:16.720036 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9fcb4c4f-c99e-475e-9e18-b3ecefc7ad20 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:16.721457 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9fcb4c4f-c99e-475e-9e18-b3ecefc7ad20 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:16.722259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9fcb4c4f-c99e-475e-9e18-b3ecefc7ad20 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:16.958406 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-9fcb4c4f-c99e-475e-9e18-b3ecefc7ad20 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:16.976454 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-9fcb4c4f-c99e-475e-9e18-b3ecefc7ad20 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1736 microversion: 2.1 time: 0.278801 Jun 21 18:36:16.977372 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 286/584] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:16 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1736 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:18.007720 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-da3df322-c549-4e8f-b4cc-4a602df336b1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:18.008907 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-da3df322-c549-4e8f-b4cc-4a602df336b1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:18.022642 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-da3df322-c549-4e8f-b4cc-4a602df336b1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:18.023388 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-da3df322-c549-4e8f-b4cc-4a602df336b1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:18.024851 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-da3df322-c549-4e8f-b4cc-4a602df336b1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:18.026355 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-da3df322-c549-4e8f-b4cc-4a602df336b1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:18.225752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-f91f02fe-7745-4d61-9882-13793f10e409 req-5ec4d145-86a0-4a18-abf7-6d075460a824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35920613-c14d-4e14-8d6d-bb7b8aad3580", "tag": "1726067c-21f2-4c33-a050-983a29ae5f04"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:18.247147 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-f91f02fe-7745-4d61-9882-13793f10e409 req-5ec4d145-86a0-4a18-abf7-6d075460a824 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:18.247899 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-f91f02fe-7745-4d61-9882-13793f10e409 req-5ec4d145-86a0-4a18-abf7-6d075460a824 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:18.274988 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-f91f02fe-7745-4d61-9882-13793f10e409 req-5ec4d145-86a0-4a18-abf7-6d075460a824 service nova] Creating event network-changed:1726067c-21f2-4c33-a050-983a29ae5f04 for instance 35920613-c14d-4e14-8d6d-bb7b8aad3580 on hv-cinder-84460 Jun 21 18:36:18.290137 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-f91f02fe-7745-4d61-9882-13793f10e409 req-5ec4d145-86a0-4a18-abf7-6d075460a824 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177798 Jun 21 18:36:18.292583 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 287/585] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:36:18.349032 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-da3df322-c549-4e8f-b4cc-4a602df336b1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:18.366893 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-da3df322-c549-4e8f-b4cc-4a602df336b1 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1736 microversion: 2.1 time: 0.370453 Jun 21 18:36:18.369420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 299/586] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:17 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1736 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:19.416449 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-27857b09-41ca-45d8-b59a-ac1d6b29f222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:19.417837 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-27857b09-41ca-45d8-b59a-ac1d6b29f222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:19.429930 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-27857b09-41ca-45d8-b59a-ac1d6b29f222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:19.430391 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-27857b09-41ca-45d8-b59a-ac1d6b29f222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:19.431208 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-27857b09-41ca-45d8-b59a-ac1d6b29f222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:19.431643 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-27857b09-41ca-45d8-b59a-ac1d6b29f222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:19.755112 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-27857b09-41ca-45d8-b59a-ac1d6b29f222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:19.770103 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-27857b09-41ca-45d8-b59a-ac1d6b29f222 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1736 microversion: 2.1 time: 0.361044 Jun 21 18:36:19.786376 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 288/587] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:19 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1736 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:20.221236 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6b9e4489-ced2-406b-86ec-61c834d3aef9 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-383546993"}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:20.222169 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6b9e4489-ced2-406b-86ec-61c834d3aef9 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:20.239104 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6b9e4489-ced2-406b-86ec-61c834d3aef9 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:20.239778 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6b9e4489-ced2-406b-86ec-61c834d3aef9 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:20.241230 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6b9e4489-ced2-406b-86ec-61c834d3aef9 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:20.241848 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6b9e4489-ced2-406b-86ec-61c834d3aef9 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:20.465723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.network.security_group_api [None req-6b9e4489-ced2-406b-86ec-61c834d3aef9 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Adding security group d969a2fa-04de-46db-8950-690e9c17baa9 to port 1726067c-21f2-4c33-a050-983a29ae5f04 Jun 21 18:36:20.800561 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-ef865873-7988-4ca8-abfc-175a9a969b44 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:20.801872 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-ef865873-7988-4ca8-abfc-175a9a969b44 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:20.813887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef865873-7988-4ca8-abfc-175a9a969b44 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:20.815147 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef865873-7988-4ca8-abfc-175a9a969b44 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:20.816584 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef865873-7988-4ca8-abfc-175a9a969b44 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:20.817328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef865873-7988-4ca8-abfc-175a9a969b44 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:21.390290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ef865873-7988-4ca8-abfc-175a9a969b44 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:21.409445 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-ef865873-7988-4ca8-abfc-175a9a969b44 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1736 microversion: 2.1 time: 0.616757 Jun 21 18:36:21.410952 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 289/588] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:20 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1736 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:21.870965 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6b9e4489-ced2-406b-86ec-61c834d3aef9 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "POST /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580/action" status: 202 len: 0 microversion: 2.1 time: 1.658149 Jun 21 18:36:21.890285 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 300/589] 10.222.0.87 () {60 vars in 1277 bytes} [Tue Jun 21 18:36:20 2022] POST /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580/action => generated 0 bytes in 1679 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:36:21.893427 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-fa3cd281-639a-4ee1-87f8-e68a1e7f862e req-5e58577d-8f30-44ca-a77e-dc4d70363f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35920613-c14d-4e14-8d6d-bb7b8aad3580", "tag": "1726067c-21f2-4c33-a050-983a29ae5f04"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:21.901662 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-d2e01734-a14d-492e-b73f-4b56e85b8523 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:21.903250 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-d2e01734-a14d-492e-b73f-4b56e85b8523 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:21.912706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-fa3cd281-639a-4ee1-87f8-e68a1e7f862e req-5e58577d-8f30-44ca-a77e-dc4d70363f46 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:21.913923 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-fa3cd281-639a-4ee1-87f8-e68a1e7f862e req-5e58577d-8f30-44ca-a77e-dc4d70363f46 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:21.916477 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d2e01734-a14d-492e-b73f-4b56e85b8523 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:21.918593 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d2e01734-a14d-492e-b73f-4b56e85b8523 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:21.921604 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d2e01734-a14d-492e-b73f-4b56e85b8523 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:21.923223 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d2e01734-a14d-492e-b73f-4b56e85b8523 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:21.948368 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-fa3cd281-639a-4ee1-87f8-e68a1e7f862e req-5e58577d-8f30-44ca-a77e-dc4d70363f46 service nova] Creating event network-changed:1726067c-21f2-4c33-a050-983a29ae5f04 for instance 35920613-c14d-4e14-8d6d-bb7b8aad3580 on hv-cinder-84460 Jun 21 18:36:21.958659 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-fa3cd281-639a-4ee1-87f8-e68a1e7f862e req-5e58577d-8f30-44ca-a77e-dc4d70363f46 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072521 Jun 21 18:36:21.960113 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 290/590] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:36:21.973025 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-fca920c4-c653-4fa9-a6cd-ece068d8f066 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:21.974364 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-fca920c4-c653-4fa9-a6cd-ece068d8f066 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:21.994561 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fca920c4-c653-4fa9-a6cd-ece068d8f066 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:21.995687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fca920c4-c653-4fa9-a6cd-ece068d8f066 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:21.998782 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fca920c4-c653-4fa9-a6cd-ece068d8f066 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:22.000128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fca920c4-c653-4fa9-a6cd-ece068d8f066 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:22.203043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.objects.instance [None req-fca920c4-c653-4fa9-a6cd-ece068d8f066 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lazy-loading 'services' on Instance uuid f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e {{(pid=118108) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:36:22.373095 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-fca920c4-c653-4fa9-a6cd-ece068d8f066 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e/os-volume_attachments/09ddef93-4298-4613-bb94-eacadf0a6d9d" status: 202 len: 0 microversion: 2.1 time: 0.410378 Jun 21 18:36:22.382035 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 291/591] 10.222.0.87 () {58 vars in 1415 bytes} [Tue Jun 21 18:36:21 2022] DELETE /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e/os-volume_attachments/09ddef93-4298-4613-bb94-eacadf0a6d9d => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:36:22.435283 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2dd957ae-b64e-48aa-ae7f-ebcf5e96cc4b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:22.436188 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-2dd957ae-b64e-48aa-ae7f-ebcf5e96cc4b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:22.454689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2dd957ae-b64e-48aa-ae7f-ebcf5e96cc4b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:22.455223 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2dd957ae-b64e-48aa-ae7f-ebcf5e96cc4b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:22.456036 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2dd957ae-b64e-48aa-ae7f-ebcf5e96cc4b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:22.456465 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2dd957ae-b64e-48aa-ae7f-ebcf5e96cc4b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:22.471471 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-d2e01734-a14d-492e-b73f-4b56e85b8523 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:22.495874 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-d2e01734-a14d-492e-b73f-4b56e85b8523 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1639 microversion: 2.1 time: 0.603782 Jun 21 18:36:22.496454 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 301/592] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:21 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1639 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:22.736265 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2dd957ae-b64e-48aa-ae7f-ebcf5e96cc4b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:22.750614 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2dd957ae-b64e-48aa-ae7f-ebcf5e96cc4b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1716 microversion: 2.1 time: 0.318768 Jun 21 18:36:22.751816 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 292/593] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:22 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1716 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:22.855907 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f21c544e-067d-421f-8f74-3c038cd663d8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:22.856821 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f21c544e-067d-421f-8f74-3c038cd663d8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:22.866668 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f21c544e-067d-421f-8f74-3c038cd663d8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:22.867315 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f21c544e-067d-421f-8f74-3c038cd663d8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:22.868306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f21c544e-067d-421f-8f74-3c038cd663d8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:22.868845 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f21c544e-067d-421f-8f74-3c038cd663d8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:23.046389 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-f21c544e-067d-421f-8f74-3c038cd663d8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] HTTP exception thrown: Cannot 'detach_volume' instance 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc while it is in vm_state rescued Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f21c544e-067d-421f-8f74-3c038cd663d8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Request method failure captured: Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: DELETE /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/os-volume_attachments/8a3192c1-8650-4f6a-afd5-2bd25f3ca609 HTTP/1.1 Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg3_Pnx5ZJZEy_IdO1FVKKz0eLIc_62ltL3NJ6cmKflv6yZyt7QxyJvFplTihWds8VBITWE0yiTGANcSfrrGMK4zcFgLYB379BkRv2UsJO-YDM9lyF0_DS77njTRdJg7kVpdIgc_ghlZeUGuKsri6aMYf7i959Igr4Q6i6zwhEftaP4 Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 6538654ef94d4036a7a8d5614b80b0ed Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-813750082 Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:36:23.049187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:36:23.051889 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:36:23.051889 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-ServerRescueNegativeTestJSON-813750082 Jun 21 18:36:23.051889 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 6538654ef94d4036a7a8d5614b80b0ed Jun 21 18:36:23.051889 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-813750082 Jun 21 18:36:23.051889 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-ServerRescueNegativeTestJSON-813750082-project Jun 21 18:36:23.051889 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:36:23.051889 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:36:23.051889 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: de09b91800314d06aeddafe3c12a77b3 Jun 21 18:36:23.051889 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-ServerRescueNegativeTestJSON-813750082-project Jun 21 18:36:23.051889 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:36:23.051889 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Cannot 'detach_volume' instance 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc while it is in vm_state rescued Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'server_id': '0a2aebe7-f120-48fd-8aa0-7e91b857e1cc', 'id': '8a3192c1-8650-4f6a-afd5-2bd25f3ca609'} Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:36:23.054748 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:36:23.059757 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 21 18:36:23.059757 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 18:36:23.059757 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 18:36:23.059757 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 18:36:23.059757 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc while it is in vm_state rescued Jun 21 18:36:23.059757 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:36:23.059757 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:36:23.059757 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:36:23.059757 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:36:23.059757 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:36:23.059757 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:36:23.059757 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:36:23.059757 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:36:23.059757 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc while it is in vm_state rescued Jun 21 18:36:23.059757 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:36:23.059757 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f21c544e-067d-421f-8f74-3c038cd663d8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Returning 409 to user: Cannot 'detach_volume' instance 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc while it is in vm_state rescued {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:36:23.064668 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f21c544e-067d-421f-8f74-3c038cd663d8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "DELETE /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/os-volume_attachments/8a3192c1-8650-4f6a-afd5-2bd25f3ca609" status: 409 len: 152 microversion: 2.1 time: 0.206100 Jun 21 18:36:23.064668 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 302/594] 10.222.0.87 () {58 vars in 1415 bytes} [Tue Jun 21 18:36:22 2022] DELETE /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/os-volume_attachments/8a3192c1-8650-4f6a-afd5-2bd25f3ca609 => generated 152 bytes in 208 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 21 18:36:23.067784 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-94e5d278-ff2c-421a-b4f9-458e23349a27 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:23.068686 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-94e5d278-ff2c-421a-b4f9-458e23349a27 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:23.082933 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-94e5d278-ff2c-421a-b4f9-458e23349a27 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:23.083869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-94e5d278-ff2c-421a-b4f9-458e23349a27 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:23.085738 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-94e5d278-ff2c-421a-b4f9-458e23349a27 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:23.086268 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-94e5d278-ff2c-421a-b4f9-458e23349a27 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:23.212718 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-94e5d278-ff2c-421a-b4f9-458e23349a27 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "POST /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/action" status: 202 len: 0 microversion: 2.1 time: 0.152478 Jun 21 18:36:23.213624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 293/595] 10.222.0.87 () {60 vars in 1277 bytes} [Tue Jun 21 18:36:23 2022] POST /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:36:23.225504 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2ed6d2cc-9ca1-495e-97a9-b6c0b5c24f17 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:23.227004 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-2ed6d2cc-9ca1-495e-97a9-b6c0b5c24f17 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:23.240606 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2ed6d2cc-9ca1-495e-97a9-b6c0b5c24f17 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:23.241810 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2ed6d2cc-9ca1-495e-97a9-b6c0b5c24f17 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:23.243351 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2ed6d2cc-9ca1-495e-97a9-b6c0b5c24f17 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:23.244269 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2ed6d2cc-9ca1-495e-97a9-b6c0b5c24f17 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:23.538832 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2ed6d2cc-9ca1-495e-97a9-b6c0b5c24f17 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:23.555866 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-2ed6d2cc-9ca1-495e-97a9-b6c0b5c24f17 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1724 microversion: 2.1 time: 0.336059 Jun 21 18:36:23.559330 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 303/596] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:23 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:24.582871 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-26d44821-6560-47d6-836b-1f5ef8e41751 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:24.584145 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-26d44821-6560-47d6-836b-1f5ef8e41751 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:24.596504 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-26d44821-6560-47d6-836b-1f5ef8e41751 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:24.597235 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-26d44821-6560-47d6-836b-1f5ef8e41751 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:24.598597 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-26d44821-6560-47d6-836b-1f5ef8e41751 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:24.599305 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-26d44821-6560-47d6-836b-1f5ef8e41751 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:24.775847 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ff116ccf-47d0-42a2-92eb-252b73c46c6e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:24.787972 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ff116ccf-47d0-42a2-92eb-252b73c46c6e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:24.788626 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ff116ccf-47d0-42a2-92eb-252b73c46c6e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:24.833626 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ff116ccf-47d0-42a2-92eb-252b73c46c6e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Going to try to stop instance {{(pid=118109) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 18:36:24.836672 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-26d44821-6560-47d6-836b-1f5ef8e41751 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:24.856853 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-26d44821-6560-47d6-836b-1f5ef8e41751 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1724 microversion: 2.1 time: 0.282265 Jun 21 18:36:24.857997 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 294/597] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:24 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:24.902063 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ff116ccf-47d0-42a2-92eb-252b73c46c6e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "POST /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e/action" status: 202 len: 0 microversion: 2.1 time: 0.134781 Jun 21 18:36:24.902747 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 304/598] 10.222.0.87 () {60 vars in 1277 bytes} [Tue Jun 21 18:36:24 2022] POST /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 18:36:24.917207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a8536c4a-5cf9-496c-8ead-740c245163d4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:24.918362 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-a8536c4a-5cf9-496c-8ead-740c245163d4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:24.930117 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a8536c4a-5cf9-496c-8ead-740c245163d4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:24.930902 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a8536c4a-5cf9-496c-8ead-740c245163d4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:24.932477 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a8536c4a-5cf9-496c-8ead-740c245163d4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:24.933246 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a8536c4a-5cf9-496c-8ead-740c245163d4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:25.163294 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-a8536c4a-5cf9-496c-8ead-740c245163d4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:25.177770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a8536c4a-5cf9-496c-8ead-740c245163d4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1677 microversion: 2.1 time: 0.267525 Jun 21 18:36:25.178866 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 295/599] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:24 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1677 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:25.885886 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ee12849e-043d-4c75-8c2c-c6626acd1da7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:25.886757 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ee12849e-043d-4c75-8c2c-c6626acd1da7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:25.900073 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ee12849e-043d-4c75-8c2c-c6626acd1da7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:25.901006 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ee12849e-043d-4c75-8c2c-c6626acd1da7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:25.901987 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ee12849e-043d-4c75-8c2c-c6626acd1da7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:25.902452 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ee12849e-043d-4c75-8c2c-c6626acd1da7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:26.119479 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ee12849e-043d-4c75-8c2c-c6626acd1da7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:26.134032 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ee12849e-043d-4c75-8c2c-c6626acd1da7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1724 microversion: 2.1 time: 0.252710 Jun 21 18:36:26.134963 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 305/600] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:25 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:26.204941 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-bc1cff08-f173-4829-9d67-87ccce2052eb tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:26.206408 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-bc1cff08-f173-4829-9d67-87ccce2052eb tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:26.217243 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bc1cff08-f173-4829-9d67-87ccce2052eb tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:26.218119 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bc1cff08-f173-4829-9d67-87ccce2052eb tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:26.219512 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bc1cff08-f173-4829-9d67-87ccce2052eb tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:26.220274 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bc1cff08-f173-4829-9d67-87ccce2052eb tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:26.238697 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:26.396638 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-bc1cff08-f173-4829-9d67-87ccce2052eb tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:26.405914 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-bc1cff08-f173-4829-9d67-87ccce2052eb tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1677 microversion: 2.1 time: 0.205379 Jun 21 18:36:26.406589 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 296/601] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:26 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1677 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:27.153685 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-605f2f84-19bb-4ead-83f9-d0bfef2ed91b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:27.154599 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-605f2f84-19bb-4ead-83f9-d0bfef2ed91b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:27.163785 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-605f2f84-19bb-4ead-83f9-d0bfef2ed91b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:27.164435 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-605f2f84-19bb-4ead-83f9-d0bfef2ed91b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:27.165670 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-605f2f84-19bb-4ead-83f9-d0bfef2ed91b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:27.166162 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-605f2f84-19bb-4ead-83f9-d0bfef2ed91b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:27.388675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-605f2f84-19bb-4ead-83f9-d0bfef2ed91b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:27.394812 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:27.402120 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-605f2f84-19bb-4ead-83f9-d0bfef2ed91b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1724 microversion: 2.1 time: 0.252664 Jun 21 18:36:27.402852 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 306/602] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:27 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:27.433957 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-bb15e0dc-bea8-4bb7-8012-49213a302221 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:27.435147 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-bb15e0dc-bea8-4bb7-8012-49213a302221 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:27.447633 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bb15e0dc-bea8-4bb7-8012-49213a302221 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:27.448458 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bb15e0dc-bea8-4bb7-8012-49213a302221 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:27.449825 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bb15e0dc-bea8-4bb7-8012-49213a302221 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:27.450347 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bb15e0dc-bea8-4bb7-8012-49213a302221 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:27.677687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-bb15e0dc-bea8-4bb7-8012-49213a302221 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:27.689480 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-bb15e0dc-bea8-4bb7-8012-49213a302221 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1677 microversion: 2.1 time: 0.261703 Jun 21 18:36:27.690025 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 297/603] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:27 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1677 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:28.424774 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-4f9ae732-9580-4127-ae27-6cadeb2a128b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:28.425744 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-4f9ae732-9580-4127-ae27-6cadeb2a128b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:28.438657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4f9ae732-9580-4127-ae27-6cadeb2a128b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:28.439421 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4f9ae732-9580-4127-ae27-6cadeb2a128b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:28.440607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4f9ae732-9580-4127-ae27-6cadeb2a128b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:28.441603 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4f9ae732-9580-4127-ae27-6cadeb2a128b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:28.639290 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-4f9ae732-9580-4127-ae27-6cadeb2a128b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:28.649050 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-4f9ae732-9580-4127-ae27-6cadeb2a128b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1730 microversion: 2.1 time: 0.231599 Jun 21 18:36:28.649996 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 307/604] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:28 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:28.675571 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-97a10969-b8aa-43ff-b70e-c2e6a452920c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:28.676307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-97a10969-b8aa-43ff-b70e-c2e6a452920c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:28.686835 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-97a10969-b8aa-43ff-b70e-c2e6a452920c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:28.687415 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-97a10969-b8aa-43ff-b70e-c2e6a452920c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:28.688508 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-97a10969-b8aa-43ff-b70e-c2e6a452920c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:28.689308 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-97a10969-b8aa-43ff-b70e-c2e6a452920c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:28.720820 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-3538e646-3b75-4e19-bbe1-6cfa89bd8f9f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:28.722271 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-3538e646-3b75-4e19-bbe1-6cfa89bd8f9f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:28.733268 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3538e646-3b75-4e19-bbe1-6cfa89bd8f9f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:28.734097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3538e646-3b75-4e19-bbe1-6cfa89bd8f9f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:28.735591 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3538e646-3b75-4e19-bbe1-6cfa89bd8f9f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:28.736512 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-3538e646-3b75-4e19-bbe1-6cfa89bd8f9f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:28.873374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-97a10969-b8aa-43ff-b70e-c2e6a452920c tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.205011 Jun 21 18:36:28.877412 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 298/605] 10.222.0.87 () {58 vars in 1274 bytes} [Tue Jun 21 18:36:28 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:36:28.986961 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-3538e646-3b75-4e19-bbe1-6cfa89bd8f9f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:29.001713 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-3538e646-3b75-4e19-bbe1-6cfa89bd8f9f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1677 microversion: 2.1 time: 0.287911 Jun 21 18:36:29.002771 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 308/606] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:28 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1677 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:30.031791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-51458b40-ed67-484f-a329-998f1973bad2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:30.032840 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-51458b40-ed67-484f-a329-998f1973bad2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:30.042502 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-51458b40-ed67-484f-a329-998f1973bad2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:30.043118 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-51458b40-ed67-484f-a329-998f1973bad2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:30.044278 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-51458b40-ed67-484f-a329-998f1973bad2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:30.045097 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-51458b40-ed67-484f-a329-998f1973bad2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:30.288863 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-f51ccdf6-c105-4a6e-a83e-569a65fdec3d req-c2b07175-0aa6-4f33-8257-86f4d85dd61b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2aebe7-f120-48fd-8aa0-7e91b857e1cc", "tag": "fbfe0125-66e4-4f30-a67a-e407b7aed936"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:30.300272 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-51458b40-ed67-484f-a329-998f1973bad2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:30.307136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-f51ccdf6-c105-4a6e-a83e-569a65fdec3d req-c2b07175-0aa6-4f33-8257-86f4d85dd61b service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:30.308135 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-f51ccdf6-c105-4a6e-a83e-569a65fdec3d req-c2b07175-0aa6-4f33-8257-86f4d85dd61b service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:30.318504 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-51458b40-ed67-484f-a329-998f1973bad2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1677 microversion: 2.1 time: 0.294604 Jun 21 18:36:30.320815 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 299/607] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:30 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1677 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:30.332193 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-f51ccdf6-c105-4a6e-a83e-569a65fdec3d req-c2b07175-0aa6-4f33-8257-86f4d85dd61b service nova] Creating event network-changed:fbfe0125-66e4-4f30-a67a-e407b7aed936 for instance 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc on hv-cinder-84460 Jun 21 18:36:30.343880 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-f51ccdf6-c105-4a6e-a83e-569a65fdec3d req-c2b07175-0aa6-4f33-8257-86f4d85dd61b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062401 Jun 21 18:36:30.344960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 309/608] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:36:31.349105 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-861efe30-dc20-467e-9775-103cfa5ccb48 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:31.350157 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-861efe30-dc20-467e-9775-103cfa5ccb48 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:31.361304 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-861efe30-dc20-467e-9775-103cfa5ccb48 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:31.362025 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-861efe30-dc20-467e-9775-103cfa5ccb48 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:31.363264 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-861efe30-dc20-467e-9775-103cfa5ccb48 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:31.363939 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-861efe30-dc20-467e-9775-103cfa5ccb48 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:31.587046 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-861efe30-dc20-467e-9775-103cfa5ccb48 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:31.601029 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-861efe30-dc20-467e-9775-103cfa5ccb48 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1677 microversion: 2.1 time: 0.258052 Jun 21 18:36:31.602507 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 300/609] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:31 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1677 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:32.363575 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-6c1830b9-b730-494e-b1d6-5a0e2625cc7e req-fc38f34e-49fc-4e62-acbf-5acb92592514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a2aebe7-f120-48fd-8aa0-7e91b857e1cc", "tag": "fbfe0125-66e4-4f30-a67a-e407b7aed936"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:32.374028 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-6c1830b9-b730-494e-b1d6-5a0e2625cc7e req-fc38f34e-49fc-4e62-acbf-5acb92592514 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:32.374502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-6c1830b9-b730-494e-b1d6-5a0e2625cc7e req-fc38f34e-49fc-4e62-acbf-5acb92592514 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:32.387449 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-6c1830b9-b730-494e-b1d6-5a0e2625cc7e req-fc38f34e-49fc-4e62-acbf-5acb92592514 service nova] Creating event network-changed:fbfe0125-66e4-4f30-a67a-e407b7aed936 for instance 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc on hv-cinder-84460 Jun 21 18:36:32.394288 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-6c1830b9-b730-494e-b1d6-5a0e2625cc7e req-fc38f34e-49fc-4e62-acbf-5acb92592514 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035435 Jun 21 18:36:32.394920 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 310/610] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:36:32.627174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-97f340d0-097d-4e24-8b40-21751247396c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:32.628143 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-97f340d0-097d-4e24-8b40-21751247396c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:32.640064 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-97f340d0-097d-4e24-8b40-21751247396c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:32.640834 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-97f340d0-097d-4e24-8b40-21751247396c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:32.642311 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-97f340d0-097d-4e24-8b40-21751247396c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:32.643098 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-97f340d0-097d-4e24-8b40-21751247396c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:32.895226 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-97f340d0-097d-4e24-8b40-21751247396c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:32.906575 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-97f340d0-097d-4e24-8b40-21751247396c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1677 microversion: 2.1 time: 0.286445 Jun 21 18:36:32.907614 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 301/611] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:32 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1677 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:33.936429 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f72dc766-5f98-481d-a57d-983522e64909 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:33.937595 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f72dc766-5f98-481d-a57d-983522e64909 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:33.945740 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f72dc766-5f98-481d-a57d-983522e64909 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:33.946395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f72dc766-5f98-481d-a57d-983522e64909 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:33.947710 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f72dc766-5f98-481d-a57d-983522e64909 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:33.948449 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f72dc766-5f98-481d-a57d-983522e64909 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:34.174135 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f72dc766-5f98-481d-a57d-983522e64909 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:34.184820 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f72dc766-5f98-481d-a57d-983522e64909 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1677 microversion: 2.1 time: 0.254155 Jun 21 18:36:34.185685 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 311/612] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:33 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1677 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:35.208239 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2edcbd62-5915-49be-a644-6069809a50ad tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:35.209388 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-2edcbd62-5915-49be-a644-6069809a50ad tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:35.223068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2edcbd62-5915-49be-a644-6069809a50ad tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:35.223865 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2edcbd62-5915-49be-a644-6069809a50ad tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:35.225304 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2edcbd62-5915-49be-a644-6069809a50ad tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:35.226119 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2edcbd62-5915-49be-a644-6069809a50ad tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:35.448593 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2edcbd62-5915-49be-a644-6069809a50ad tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:35.457757 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2edcbd62-5915-49be-a644-6069809a50ad tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1677 microversion: 2.1 time: 0.257380 Jun 21 18:36:35.458696 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 302/613] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:35 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1677 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:36.486367 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f44f437f-efc8-4219-a7d3-1d03b8ed2f3d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:36.487202 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f44f437f-efc8-4219-a7d3-1d03b8ed2f3d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:36.497449 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f44f437f-efc8-4219-a7d3-1d03b8ed2f3d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:36.498277 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f44f437f-efc8-4219-a7d3-1d03b8ed2f3d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:36.499336 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f44f437f-efc8-4219-a7d3-1d03b8ed2f3d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:36.500016 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f44f437f-efc8-4219-a7d3-1d03b8ed2f3d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:36.718551 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f44f437f-efc8-4219-a7d3-1d03b8ed2f3d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:36.730915 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f44f437f-efc8-4219-a7d3-1d03b8ed2f3d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1677 microversion: 2.1 time: 0.250179 Jun 21 18:36:36.731951 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 312/614] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:36 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1677 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:37.752789 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4cd94b34-4f46-4c91-a28c-ddcbaf883890 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:37.753756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4cd94b34-4f46-4c91-a28c-ddcbaf883890 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:37.757143 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=46 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:37.764778 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4cd94b34-4f46-4c91-a28c-ddcbaf883890 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:37.765390 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4cd94b34-4f46-4c91-a28c-ddcbaf883890 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:37.766855 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4cd94b34-4f46-4c91-a28c-ddcbaf883890 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:37.767640 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4cd94b34-4f46-4c91-a28c-ddcbaf883890 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:37.954288 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-4cd94b34-4f46-4c91-a28c-ddcbaf883890 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:37.963162 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4cd94b34-4f46-4c91-a28c-ddcbaf883890 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1677 microversion: 2.1 time: 0.216590 Jun 21 18:36:37.963749 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 303/615] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:37 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:38.986081 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bc3316e2-4cbc-41c1-88f0-fdf6fec455e8 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:38.987128 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-bc3316e2-4cbc-41c1-88f0-fdf6fec455e8 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:38.991825 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=38 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:39.002275 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bc3316e2-4cbc-41c1-88f0-fdf6fec455e8 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:39.003074 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bc3316e2-4cbc-41c1-88f0-fdf6fec455e8 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:39.004611 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bc3316e2-4cbc-41c1-88f0-fdf6fec455e8 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:39.004611 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bc3316e2-4cbc-41c1-88f0-fdf6fec455e8 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:39.223550 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-bc3316e2-4cbc-41c1-88f0-fdf6fec455e8 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:39.238165 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-bc3316e2-4cbc-41c1-88f0-fdf6fec455e8 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1677 microversion: 2.1 time: 0.259295 Jun 21 18:36:39.239214 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 313/616] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:38 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1677 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:40.265355 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2e11b50b-a011-4a89-b0cb-55204a480a7f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:40.266391 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-2e11b50b-a011-4a89-b0cb-55204a480a7f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:40.276863 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e11b50b-a011-4a89-b0cb-55204a480a7f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:40.277854 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e11b50b-a011-4a89-b0cb-55204a480a7f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:40.279308 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e11b50b-a011-4a89-b0cb-55204a480a7f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:40.280005 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e11b50b-a011-4a89-b0cb-55204a480a7f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:40.447429 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2e11b50b-a011-4a89-b0cb-55204a480a7f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:40.456722 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2e11b50b-a011-4a89-b0cb-55204a480a7f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1677 microversion: 2.1 time: 0.197499 Jun 21 18:36:40.457283 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 304/617] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:40 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1677 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:41.486152 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-be49270c-d3a5-47cb-a521-3168eb524cae tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:41.486998 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-be49270c-d3a5-47cb-a521-3168eb524cae tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:41.494643 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-be49270c-d3a5-47cb-a521-3168eb524cae tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:41.495074 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-be49270c-d3a5-47cb-a521-3168eb524cae tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:41.495840 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-be49270c-d3a5-47cb-a521-3168eb524cae tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:41.496262 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-be49270c-d3a5-47cb-a521-3168eb524cae tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:41.671448 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-be49270c-d3a5-47cb-a521-3168eb524cae tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:41.682278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-be49270c-d3a5-47cb-a521-3168eb524cae tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1677 microversion: 2.1 time: 0.200902 Jun 21 18:36:41.682866 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 314/618] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:41 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:42.705591 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-886f70f9-cde7-43e2-b903-a69d1f77db7f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:42.706667 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-886f70f9-cde7-43e2-b903-a69d1f77db7f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:42.720759 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-886f70f9-cde7-43e2-b903-a69d1f77db7f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:42.721726 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-886f70f9-cde7-43e2-b903-a69d1f77db7f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:42.723051 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-886f70f9-cde7-43e2-b903-a69d1f77db7f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:42.723851 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-886f70f9-cde7-43e2-b903-a69d1f77db7f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:42.964586 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-886f70f9-cde7-43e2-b903-a69d1f77db7f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:42.976967 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-886f70f9-cde7-43e2-b903-a69d1f77db7f tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1654 microversion: 2.1 time: 0.278782 Jun 21 18:36:42.977766 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 305/619] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:42 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1654 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:42.999620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-511c6e6b-74ce-4617-80be-804dd03ad303 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:43.010440 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-511c6e6b-74ce-4617-80be-804dd03ad303 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:43.011084 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-511c6e6b-74ce-4617-80be-804dd03ad303 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:43.041075 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-511c6e6b-74ce-4617-80be-804dd03ad303 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Going to try to start instance {{(pid=118109) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 18:36:43.099500 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-511c6e6b-74ce-4617-80be-804dd03ad303 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "POST /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e/action" status: 202 len: 0 microversion: 2.1 time: 0.104451 Jun 21 18:36:43.100345 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 315/620] 10.222.0.87 () {60 vars in 1277 bytes} [Tue Jun 21 18:36:42 2022] POST /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:36:43.111140 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f610fdb7-51f4-4a0d-b094-7d7f1928900b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:43.112165 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f610fdb7-51f4-4a0d-b094-7d7f1928900b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:43.123042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f610fdb7-51f4-4a0d-b094-7d7f1928900b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:43.123851 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f610fdb7-51f4-4a0d-b094-7d7f1928900b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:43.124869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f610fdb7-51f4-4a0d-b094-7d7f1928900b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:43.125538 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f610fdb7-51f4-4a0d-b094-7d7f1928900b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:43.358612 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f610fdb7-51f4-4a0d-b094-7d7f1928900b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:43.373046 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f610fdb7-51f4-4a0d-b094-7d7f1928900b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1663 microversion: 2.1 time: 0.267684 Jun 21 18:36:43.374406 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 306/621] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:43 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1663 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:44.397762 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-d1170d03-f0d9-4548-bae0-1798672f3710 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:44.398577 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-d1170d03-f0d9-4548-bae0-1798672f3710 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:44.407965 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d1170d03-f0d9-4548-bae0-1798672f3710 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:44.408559 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d1170d03-f0d9-4548-bae0-1798672f3710 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:44.409451 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d1170d03-f0d9-4548-bae0-1798672f3710 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:44.409979 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d1170d03-f0d9-4548-bae0-1798672f3710 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:44.619988 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-d1170d03-f0d9-4548-bae0-1798672f3710 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:44.630373 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-d1170d03-f0d9-4548-bae0-1798672f3710 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1663 microversion: 2.1 time: 0.237093 Jun 21 18:36:44.631171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 316/622] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:44 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1663 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:45.650820 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-887c709b-de66-4788-a45f-ad0081c30c9d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:45.651907 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-887c709b-de66-4788-a45f-ad0081c30c9d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:45.659416 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-887c709b-de66-4788-a45f-ad0081c30c9d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:45.659862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-887c709b-de66-4788-a45f-ad0081c30c9d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:45.660649 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-887c709b-de66-4788-a45f-ad0081c30c9d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:45.661080 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-887c709b-de66-4788-a45f-ad0081c30c9d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:45.817843 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b0cc62d0-8598-4604-b7f5-3b471861ec48 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:45.819518 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b0cc62d0-8598-4604-b7f5-3b471861ec48 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:45.827383 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b0cc62d0-8598-4604-b7f5-3b471861ec48 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:45.828185 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b0cc62d0-8598-4604-b7f5-3b471861ec48 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:45.829026 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b0cc62d0-8598-4604-b7f5-3b471861ec48 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:45.829471 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b0cc62d0-8598-4604-b7f5-3b471861ec48 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:45.855134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-887c709b-de66-4788-a45f-ad0081c30c9d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:45.865021 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-887c709b-de66-4788-a45f-ad0081c30c9d tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1667 microversion: 2.1 time: 0.218676 Jun 21 18:36:45.865833 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 307/623] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:45 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1667 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:45.866639 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b0cc62d0-8598-4604-b7f5-3b471861ec48 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a/ips" status: 200 len: 150 microversion: 2.1 time: 0.055358 Jun 21 18:36:45.867537 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 317/624] 10.222.0.87 () {58 vars in 1247 bytes} [Tue Jun 21 18:36:45 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a/ips => generated 150 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:36:45.881946 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2fc52f4d-af1a-4f12-b663-e1070af2e59a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10d651db-19fe-4ee4-bcc9-343480b202c5"}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:45.883168 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-2fc52f4d-af1a-4f12-b663-e1070af2e59a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:45.890435 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2fc52f4d-af1a-4f12-b663-e1070af2e59a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:45.890878 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2fc52f4d-af1a-4f12-b663-e1070af2e59a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:45.891665 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2fc52f4d-af1a-4f12-b663-e1070af2e59a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:45.892096 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2fc52f4d-af1a-4f12-b663-e1070af2e59a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:45.995215 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-2fc52f4d-af1a-4f12-b663-e1070af2e59a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] HTTP exception thrown: Invalid volume: volume 10d651db-19fe-4ee4-bcc9-343480b202c5 is already attached to instances: dd9d70a7-2f59-4922-a22c-14fe01056ae4 Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2fc52f4d-af1a-4f12-b663-e1070af2e59a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Request method failure captured: Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: POST /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a/os-volume_attachments HTTP/1.1 Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 74 Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABisg4ZMAWXxe61N6ctbFJeKvVgvvqMTa2oRmY5e2O5Oda6LMfZg9xpstvKI3ZJkXmTItstccH4E1PbiQoDoOZ0pGDVym3uwQfnL3hWTQsURjldIWUJ8D1X_g1vsEm62qgxRWdgSwijxdtKtfaabBZ19cJ69ajwcodYMs6ciOaGSF1872Y Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:36:46.000661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:36:46.003756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:36:46.003756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:36:46.003756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:36:46.003756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:36:46.003756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:36:46.003756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:36:46.003756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:36:46.003756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 144c9c31ed9b469aa200dcb16c89ab4e Jun 21 18:36:46.003756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:36:46.003756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Jun 21 18:36:46.003756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {"volumeAttachment": {"volumeId": "10d651db-19fe-4ee4-bcc9-343480b202c5"}} Jun 21 18:36:46.003756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:36:46.006541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Invalid volume: volume 10d651db-19fe-4ee4-bcc9-343480b202c5 is already attached to instances: dd9d70a7-2f59-4922-a22c-14fe01056ae4 Jun 21 18:36:46.006541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'server_id': '0311fe1f-2643-49b9-89a6-ebfb7d63430a', 'body': {'volumeAttachment': {'volumeId': '10d651db-19fe-4ee4-bcc9-343480b202c5'}}} Jun 21 18:36:46.006541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:36:46.006541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:36:46.006541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 18:36:46.006541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 18:36:46.006541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 18:36:46.006541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 18:36:46.006541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 18:36:46.006541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 18:36:46.006541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 18:36:46.006541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 18:36:46.006541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 18:36:46.006541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 18:36:46.006541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 10d651db-19fe-4ee4-bcc9-343480b202c5 is already attached to instances: dd9d70a7-2f59-4922-a22c-14fe01056ae4 Jun 21 18:36:46.006541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:36:46.006541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:36:46.006541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:36:46.006541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 10d651db-19fe-4ee4-bcc9-343480b202c5 is already attached to instances: dd9d70a7-2f59-4922-a22c-14fe01056ae4 Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:36:46.008717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:36:46.011103 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:36:46.011103 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:36:46.011103 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:36:46.011103 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 10d651db-19fe-4ee4-bcc9-343480b202c5 is already attached to instances: dd9d70a7-2f59-4922-a22c-14fe01056ae4 Jun 21 18:36:46.011103 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:36:46.011103 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2fc52f4d-af1a-4f12-b663-e1070af2e59a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Returning 400 to user: Invalid volume: volume 10d651db-19fe-4ee4-bcc9-343480b202c5 is already attached to instances: dd9d70a7-2f59-4922-a22c-14fe01056ae4 {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:36:46.011103 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2fc52f4d-af1a-4f12-b663-e1070af2e59a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "POST /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.126231 Jun 21 18:36:46.011103 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 308/625] 10.222.0.87 () {60 vars in 1322 bytes} [Tue Jun 21 18:36:45 2022] POST /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a/os-volume_attachments => generated 174 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 18:36:46.018992 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-da813f07-f78a-4522-892f-3650fb45b7e9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:46.020066 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-da813f07-f78a-4522-892f-3650fb45b7e9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:46.030215 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-da813f07-f78a-4522-892f-3650fb45b7e9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:46.031019 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-da813f07-f78a-4522-892f-3650fb45b7e9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:46.032411 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-da813f07-f78a-4522-892f-3650fb45b7e9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:46.033575 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-da813f07-f78a-4522-892f-3650fb45b7e9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:46.075484 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-da813f07-f78a-4522-892f-3650fb45b7e9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Going to try to terminate instance {{(pid=118109) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:36:46.207879 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-da813f07-f78a-4522-892f-3650fb45b7e9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "DELETE /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 204 len: 0 microversion: 2.1 time: 0.196063 Jun 21 18:36:46.208685 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 318/626] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:36:46 2022] DELETE /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 18:36:46.222121 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-df383771-8050-4484-9735-1ad6c8acccb9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:46.223018 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-df383771-8050-4484-9735-1ad6c8acccb9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:46.233536 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-df383771-8050-4484-9735-1ad6c8acccb9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:46.234146 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-df383771-8050-4484-9735-1ad6c8acccb9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:46.235107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-df383771-8050-4484-9735-1ad6c8acccb9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:46.235555 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-df383771-8050-4484-9735-1ad6c8acccb9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:46.437705 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-df383771-8050-4484-9735-1ad6c8acccb9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:46.446696 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-df383771-8050-4484-9735-1ad6c8acccb9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1682 microversion: 2.1 time: 0.231130 Jun 21 18:36:46.447284 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 309/627] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:46 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1682 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:47.469810 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e0a3f624-b356-4e3b-8164-f1769af76dc4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:47.470723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e0a3f624-b356-4e3b-8164-f1769af76dc4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:47.478574 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e0a3f624-b356-4e3b-8164-f1769af76dc4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:47.479084 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e0a3f624-b356-4e3b-8164-f1769af76dc4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:47.479923 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e0a3f624-b356-4e3b-8164-f1769af76dc4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:47.480404 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e0a3f624-b356-4e3b-8164-f1769af76dc4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:47.708702 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e0a3f624-b356-4e3b-8164-f1769af76dc4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:47.721428 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e0a3f624-b356-4e3b-8164-f1769af76dc4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1682 microversion: 2.1 time: 0.256897 Jun 21 18:36:47.722303 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 319/628] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:47 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1682 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:48.751709 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c3d5e47f-4c19-4271-85aa-8100b629b0dd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:48.752683 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c3d5e47f-4c19-4271-85aa-8100b629b0dd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:48.765547 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c3d5e47f-4c19-4271-85aa-8100b629b0dd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:48.766370 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c3d5e47f-4c19-4271-85aa-8100b629b0dd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:48.767863 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c3d5e47f-4c19-4271-85aa-8100b629b0dd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:48.768730 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c3d5e47f-4c19-4271-85aa-8100b629b0dd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:48.967058 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c3d5e47f-4c19-4271-85aa-8100b629b0dd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:48.980805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c3d5e47f-4c19-4271-85aa-8100b629b0dd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1682 microversion: 2.1 time: 0.235479 Jun 21 18:36:48.981864 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 310/629] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:48 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:49.596429 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-5ee5a5b9-8cf0-41fc-bd24-568f26326cd3 req-fa5d4770-8759-44f4-9baf-322b5e41691f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0311fe1f-2643-49b9-89a6-ebfb7d63430a", "name": "network-vif-deleted", "tag": "13df5c0e-52fd-4978-9066-7de50f0ca9a5"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:49.612338 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-5ee5a5b9-8cf0-41fc-bd24-568f26326cd3 req-fa5d4770-8759-44f4-9baf-322b5e41691f service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:49.613461 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-5ee5a5b9-8cf0-41fc-bd24-568f26326cd3 req-fa5d4770-8759-44f4-9baf-322b5e41691f service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:49.635261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-5ee5a5b9-8cf0-41fc-bd24-568f26326cd3 req-fa5d4770-8759-44f4-9baf-322b5e41691f service nova] Creating event network-vif-deleted:13df5c0e-52fd-4978-9066-7de50f0ca9a5 for instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a on hv-cinder-84460 Jun 21 18:36:49.645395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-5ee5a5b9-8cf0-41fc-bd24-568f26326cd3 req-fa5d4770-8759-44f4-9baf-322b5e41691f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058793 Jun 21 18:36:49.646638 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 320/630] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:36:50.007010 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-37efbf5e-bf5d-4881-9b35-dea5040e8f19 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:50.007848 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-37efbf5e-bf5d-4881-9b35-dea5040e8f19 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:50.019792 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-37efbf5e-bf5d-4881-9b35-dea5040e8f19 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:50.020842 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-37efbf5e-bf5d-4881-9b35-dea5040e8f19 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:50.022414 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-37efbf5e-bf5d-4881-9b35-dea5040e8f19 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:50.022414 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-37efbf5e-bf5d-4881-9b35-dea5040e8f19 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:50.077690 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-37efbf5e-bf5d-4881-9b35-dea5040e8f19 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:50.078407 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-37efbf5e-bf5d-4881-9b35-dea5040e8f19 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:50.079303 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.objects.instance [None req-37efbf5e-bf5d-4881-9b35-dea5040e8f19 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lazy-loading 'fault' on Instance uuid 0311fe1f-2643-49b9-89a6-ebfb7d63430a {{(pid=118108) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:36:50.141627 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-37efbf5e-bf5d-4881-9b35-dea5040e8f19 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:50.160318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-37efbf5e-bf5d-4881-9b35-dea5040e8f19 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 200 len: 1331 microversion: 2.1 time: 0.157704 Jun 21 18:36:50.161847 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 311/631] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:50 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 1331 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:51.190866 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-571603e4-2a8e-45b6-8708-b07d040944dd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:51.192220 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-571603e4-2a8e-45b6-8708-b07d040944dd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:51.204183 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-571603e4-2a8e-45b6-8708-b07d040944dd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:51.205033 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-571603e4-2a8e-45b6-8708-b07d040944dd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:51.206460 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-571603e4-2a8e-45b6-8708-b07d040944dd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:51.207324 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-571603e4-2a8e-45b6-8708-b07d040944dd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:51.240009 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-571603e4-2a8e-45b6-8708-b07d040944dd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] HTTP exception thrown: Instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a could not be found. Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-571603e4-2a8e-45b6-8708-b07d040944dd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Request method failure captured: Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a HTTP/1.1 Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg4ZMAWXxe61N6ctbFJeKvVgvvqMTa2oRmY5e2O5Oda6LMfZg9xpstvKI3ZJkXmTItstccH4E1PbiQoDoOZ0pGDVym3uwQfnL3hWTQsURjldIWUJ8D1X_g1vsEm62qgxRWdgSwijxdtKtfaabBZ19cJ69ajwcodYMs6ciOaGSF1872Y Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:36:51.244443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:36:51.246870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:36:51.246870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:36:51.246870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:36:51.246870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:36:51.246870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:36:51.246870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:36:51.246870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:36:51.246870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: 144c9c31ed9b469aa200dcb16c89ab4e Jun 21 18:36:51.246870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:36:51.246870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:36:51.246870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a could not be found. Jun 21 18:36:51.246870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': '0311fe1f-2643-49b9-89a6-ebfb7d63430a'} Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a could not be found. Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:36:51.248177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:36:51.251326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:36:51.251326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:36:51.251326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:36:51.251326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:36:51.251326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:36:51.251326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:36:51.251326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:36:51.251326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a could not be found. Jun 21 18:36:51.251326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:36:51.251326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:36:51.251326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:36:51.251326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:36:51.251326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:36:51.251326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:36:51.251326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:36:51.251326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:36:51.251326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a could not be found. Jun 21 18:36:51.251326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:36:51.254830 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-571603e4-2a8e-45b6-8708-b07d040944dd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Returning 404 to user: Instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:36:51.254830 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-571603e4-2a8e-45b6-8708-b07d040944dd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 404 len: 111 microversion: 2.1 time: 0.066278 Jun 21 18:36:51.254830 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 321/632] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:51 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:36:51.270619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-1c076497-1928-4da6-92d8-9c370ce6a163 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '.version_select at 0x7fd8b80fdaf0>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:51.307159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-1c076497-1928-4da6-92d8-9c370ce6a163 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520450228" status: 202 len: 0 microversion: 2.1 time: 0.049653 Jun 21 18:36:51.308446 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 312/633] 10.222.0.87 () {58 vars in 1220 bytes} [Tue Jun 21 18:36:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520450228 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:36:52.238249 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ba0ae436-db9c-4a43-ba32-bcb83050aa68 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:52.239124 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ba0ae436-db9c-4a43-ba32-bcb83050aa68 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:52.246406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ba0ae436-db9c-4a43-ba32-bcb83050aa68 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:52.246981 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ba0ae436-db9c-4a43-ba32-bcb83050aa68 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:52.248236 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ba0ae436-db9c-4a43-ba32-bcb83050aa68 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:52.249019 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ba0ae436-db9c-4a43-ba32-bcb83050aa68 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:52.385920 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.objects.instance [None req-ba0ae436-db9c-4a43-ba32-bcb83050aa68 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lazy-loading 'services' on Instance uuid dd9d70a7-2f59-4922-a22c-14fe01056ae4 {{(pid=118109) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:36:52.524374 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ba0ae436-db9c-4a43-ba32-bcb83050aa68 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "DELETE /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4/os-volume_attachments/10d651db-19fe-4ee4-bcc9-343480b202c5" status: 202 len: 0 microversion: 2.1 time: 0.290268 Jun 21 18:36:52.525219 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 322/634] 10.222.0.87 () {58 vars in 1415 bytes} [Tue Jun 21 18:36:52 2022] DELETE /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4/os-volume_attachments/10d651db-19fe-4ee4-bcc9-343480b202c5 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 18:36:52.536846 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-75c5aa71-f6c4-4bfb-bec9-d2a36fca8e5a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:52.537904 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-75c5aa71-f6c4-4bfb-bec9-d2a36fca8e5a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:52.551825 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-75c5aa71-f6c4-4bfb-bec9-d2a36fca8e5a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:52.552853 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-75c5aa71-f6c4-4bfb-bec9-d2a36fca8e5a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:52.554403 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-75c5aa71-f6c4-4bfb-bec9-d2a36fca8e5a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:52.555137 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-75c5aa71-f6c4-4bfb-bec9-d2a36fca8e5a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:52.603011 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-75c5aa71-f6c4-4bfb-bec9-d2a36fca8e5a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072253 Jun 21 18:36:52.603974 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 313/635] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:36:52 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:36:53.619329 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-999da08a-d133-4dac-b3f2-8e7582e911cc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:53.620679 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-999da08a-d133-4dac-b3f2-8e7582e911cc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:53.630317 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-999da08a-d133-4dac-b3f2-8e7582e911cc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:53.630317 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-999da08a-d133-4dac-b3f2-8e7582e911cc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:53.632291 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-999da08a-d133-4dac-b3f2-8e7582e911cc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:53.632291 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-999da08a-d133-4dac-b3f2-8e7582e911cc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:53.652488 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:53.690132 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-999da08a-d133-4dac-b3f2-8e7582e911cc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076363 Jun 21 18:36:53.691494 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 323/636] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:36:53 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 18:36:53.802535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4b358079-dd3d-408f-ae75-356bd60bc1dc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:53.803588 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4b358079-dd3d-408f-ae75-356bd60bc1dc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:53.818358 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4b358079-dd3d-408f-ae75-356bd60bc1dc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:53.819152 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4b358079-dd3d-408f-ae75-356bd60bc1dc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:53.820548 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4b358079-dd3d-408f-ae75-356bd60bc1dc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:53.821455 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4b358079-dd3d-408f-ae75-356bd60bc1dc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:53.831399 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=100 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:36:53.883013 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4b358079-dd3d-408f-ae75-356bd60bc1dc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Going to try to terminate instance {{(pid=118108) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:36:54.047009 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4b358079-dd3d-408f-ae75-356bd60bc1dc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "DELETE /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 204 len: 0 microversion: 2.1 time: 0.252360 Jun 21 18:36:54.048653 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 314/637] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:36:53 2022] DELETE /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:36:54.059484 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-5b05e9f2-3797-4e95-a9b4-0d2a760a267a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:54.060231 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-5b05e9f2-3797-4e95-a9b4-0d2a760a267a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:54.067482 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5b05e9f2-3797-4e95-a9b4-0d2a760a267a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:54.068142 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5b05e9f2-3797-4e95-a9b4-0d2a760a267a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:54.069574 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5b05e9f2-3797-4e95-a9b4-0d2a760a267a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:54.069960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5b05e9f2-3797-4e95-a9b4-0d2a760a267a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:54.243650 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-5b05e9f2-3797-4e95-a9b4-0d2a760a267a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:54.256969 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-5b05e9f2-3797-4e95-a9b4-0d2a760a267a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1680 microversion: 2.1 time: 0.202052 Jun 21 18:36:54.258039 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 324/638] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:54 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1680 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:55.288518 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-8d6d911d-e198-47cb-ae2e-c613d5f57777 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:55.289393 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-8d6d911d-e198-47cb-ae2e-c613d5f57777 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:55.298753 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8d6d911d-e198-47cb-ae2e-c613d5f57777 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:55.299503 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8d6d911d-e198-47cb-ae2e-c613d5f57777 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:55.300464 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8d6d911d-e198-47cb-ae2e-c613d5f57777 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:55.301029 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8d6d911d-e198-47cb-ae2e-c613d5f57777 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:55.487268 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-8d6d911d-e198-47cb-ae2e-c613d5f57777 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:55.501731 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-8d6d911d-e198-47cb-ae2e-c613d5f57777 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1680 microversion: 2.1 time: 0.220122 Jun 21 18:36:55.502778 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 315/639] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:55 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1680 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:36:56.500804 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-fda9eb79-af3f-49f3-8c0e-6fcdb7397cfb req-79ffad03-2a38-4166-820f-5c6ab99b9047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9d70a7-2f59-4922-a22c-14fe01056ae4", "name": "network-vif-deleted", "tag": "8a1f2f86-cb5f-43ed-b726-88cd6b15b327"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:56.520526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-fda9eb79-af3f-49f3-8c0e-6fcdb7397cfb req-79ffad03-2a38-4166-820f-5c6ab99b9047 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:56.521162 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-fda9eb79-af3f-49f3-8c0e-6fcdb7397cfb req-79ffad03-2a38-4166-820f-5c6ab99b9047 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:56.531492 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d240e4ca-1ac8-479a-91c0-75828be11f53 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:56.533026 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-d240e4ca-1ac8-479a-91c0-75828be11f53 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:56.542383 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d240e4ca-1ac8-479a-91c0-75828be11f53 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:56.547087 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d240e4ca-1ac8-479a-91c0-75828be11f53 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:56.550720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d240e4ca-1ac8-479a-91c0-75828be11f53 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:56.552177 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d240e4ca-1ac8-479a-91c0-75828be11f53 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:56.552764 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-fda9eb79-af3f-49f3-8c0e-6fcdb7397cfb req-79ffad03-2a38-4166-820f-5c6ab99b9047 service nova] Creating event network-vif-deleted:8a1f2f86-cb5f-43ed-b726-88cd6b15b327 for instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 on hv-cinder-84460 Jun 21 18:36:56.568243 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-fda9eb79-af3f-49f3-8c0e-6fcdb7397cfb req-79ffad03-2a38-4166-820f-5c6ab99b9047 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074138 Jun 21 18:36:56.570404 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 325/640] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:36:56.689070 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-d240e4ca-1ac8-479a-91c0-75828be11f53 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:36:56.702033 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-d240e4ca-1ac8-479a-91c0-75828be11f53 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 200 len: 1326 microversion: 2.1 time: 0.176324 Jun 21 18:36:56.703403 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 316/641] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:56 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 1326 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:36:57.735520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1fa42075-4a10-40fd-bd0c-203aca8f9a27 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:57.736663 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1fa42075-4a10-40fd-bd0c-203aca8f9a27 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:36:57.747974 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1fa42075-4a10-40fd-bd0c-203aca8f9a27 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:57.748577 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1fa42075-4a10-40fd-bd0c-203aca8f9a27 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:57.749935 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1fa42075-4a10-40fd-bd0c-203aca8f9a27 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:36:57.750579 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1fa42075-4a10-40fd-bd0c-203aca8f9a27 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:36:57.773256 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-1fa42075-4a10-40fd-bd0c-203aca8f9a27 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] HTTP exception thrown: Instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 could not be found. Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1fa42075-4a10-40fd-bd0c-203aca8f9a27 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Request method failure captured: Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 HTTP/1.1 Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg4ZMAWXxe61N6ctbFJeKvVgvvqMTa2oRmY5e2O5Oda6LMfZg9xpstvKI3ZJkXmTItstccH4E1PbiQoDoOZ0pGDVym3uwQfnL3hWTQsURjldIWUJ8D1X_g1vsEm62qgxRWdgSwijxdtKtfaabBZ19cJ69ajwcodYMs6ciOaGSF1872Y Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:36:57.775316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:36:57.777261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:36:57.777261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:36:57.777261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:36:57.777261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:36:57.777261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:36:57.777261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:36:57.777261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:36:57.777261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: 144c9c31ed9b469aa200dcb16c89ab4e Jun 21 18:36:57.777261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:36:57.777261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:36:57.777261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 could not be found. Jun 21 18:36:57.777261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': 'dd9d70a7-2f59-4922-a22c-14fe01056ae4'} Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 could not be found. Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:36:57.778614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:36:57.780072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:36:57.780072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:36:57.780072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:36:57.780072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:36:57.780072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:36:57.780072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:36:57.780072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:36:57.780072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 could not be found. Jun 21 18:36:57.780072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:36:57.780072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:36:57.780072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:36:57.780072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:36:57.780072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:36:57.780072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:36:57.780072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:36:57.780072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:36:57.780072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 could not be found. Jun 21 18:36:57.780072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:36:57.782080 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1fa42075-4a10-40fd-bd0c-203aca8f9a27 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Returning 404 to user: Instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:36:57.783354 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1fa42075-4a10-40fd-bd0c-203aca8f9a27 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 404 len: 111 microversion: 2.1 time: 0.054631 Jun 21 18:36:57.784000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 326/642] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:36:57 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:36:57.800098 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6dfe19c8-1bd7-4663-b6f1-f5b90c5d3fb8 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '.version_select at 0x7fd8b807b160>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:36:57.835952 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6dfe19c8-1bd7-4663-b6f1-f5b90c5d3fb8 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1916343093" status: 202 len: 0 microversion: 2.1 time: 0.043884 Jun 21 18:36:57.837033 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 317/643] 10.222.0.87 () {58 vars in 1220 bytes} [Tue Jun 21 18:36:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1916343093 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:36:58.734495 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ec56273e-28f5-4c3c-ad05-806d9ec3f619 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Action: 'create', calling method: .version_select at 0x7fd8b80769d0>, body: {"keypair": {"name": "tempest-keypair-1274331111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFdfeQT4IvGmP2gWSpZhQjV49WLLK8cw6bdeK/0VINi//QsVJgmpIfjPL40zGUrlVyWmo5quEXkGQxHm/dk9mFfeVA1cTsDdCpOePGA86GanyueRiiNmd8OQaI9joIgKg=="}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:36:58.761886 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-ec56273e-28f5-4c3c-ad05-806d9ec3f619 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Getting quotas for project 53e2bb9f793041c2aef6e222b76c3961. Resources: {'key_pairs'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:36:58.768889 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-ec56273e-28f5-4c3c-ad05-806d9ec3f619 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Getting quotas for user 144c9c31ed9b469aa200dcb16c89ab4e and project 53e2bb9f793041c2aef6e222b76c3961. Resources: {'key_pairs'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:36:58.800333 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ec56273e-28f5-4c3c-ad05-806d9ec3f619 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073897 Jun 21 18:36:58.801166 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 327/644] 10.222.0.87 () {60 vars in 1158 bytes} [Tue Jun 21 18:36:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:37:00.974375 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-1ba9e540-3420-4c77-9aac-d81911674092 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-892161309", "imageRef": "c28659fb-c2d3-4dda-a330-1323a974987e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "29d4e26f-e314-4e70-8390-44e86b316d90"}], "security_groups": [{"name": "tempest-securitygroup--1435898868"}], "key_name": "tempest-keypair-1274331111", "user_data": "}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:37:01.127156 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.network.neutron [None req-1ba9e540-3420-4c77-9aac-d81911674092 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] validate_networks() for [('29d4e26f-e314-4e70-8390-44e86b316d90', None, None, None, None, None)] {{(pid=118108) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:37:01.670271 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-1ba9e540-3420-4c77-9aac-d81911674092 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Flavor limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:37:01.670890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-1ba9e540-3420-4c77-9aac-d81911674092 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Image limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:37:01.671517 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-1ba9e540-3420-4c77-9aac-d81911674092 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Flavor pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:37:01.672247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-1ba9e540-3420-4c77-9aac-d81911674092 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Image pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:37:01.672773 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-1ba9e540-3420-4c77-9aac-d81911674092 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:37:01.683244 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1ba9e540-3420-4c77-9aac-d81911674092 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:01.683684 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1ba9e540-3420-4c77-9aac-d81911674092 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:01.684527 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1ba9e540-3420-4c77-9aac-d81911674092 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:01.684955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1ba9e540-3420-4c77-9aac-d81911674092 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:01.705293 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-1ba9e540-3420-4c77-9aac-d81911674092 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Getting quotas for project 53e2bb9f793041c2aef6e222b76c3961. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:37:01.710425 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-1ba9e540-3420-4c77-9aac-d81911674092 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Getting quotas for user 144c9c31ed9b469aa200dcb16c89ab4e and project 53e2bb9f793041c2aef6e222b76c3961. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:37:01.725525 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-1ba9e540-3420-4c77-9aac-d81911674092 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Going to run 1 instances... {{(pid=118108) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:37:01.728151 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-1ba9e540-3420-4c77-9aac-d81911674092 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c28659fb-c2d3-4dda-a330-1323a974987e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118108) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:37:01.783299 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-1ba9e540-3420-4c77-9aac-d81911674092 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.819588 Jun 21 18:37:01.783972 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 318/645] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:37:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:37:01.801175 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-039a985b-0535-4301-b957-02e333160c25 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:01.802122 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-039a985b-0535-4301-b957-02e333160c25 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:01.889560 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-039a985b-0535-4301-b957-02e333160c25 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:01.901023 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-039a985b-0535-4301-b957-02e333160c25 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 200 len: 1241 microversion: 2.1 time: 0.108688 Jun 21 18:37:01.901893 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 328/646] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:01 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:37:02.929344 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-0812a2be-a1b7-4b2e-97e0-a7da574b4edb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:02.930372 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-0812a2be-a1b7-4b2e-97e0-a7da574b4edb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:02.941689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0812a2be-a1b7-4b2e-97e0-a7da574b4edb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:02.942492 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0812a2be-a1b7-4b2e-97e0-a7da574b4edb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:02.943868 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0812a2be-a1b7-4b2e-97e0-a7da574b4edb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:02.944671 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0812a2be-a1b7-4b2e-97e0-a7da574b4edb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:03.026651 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-0812a2be-a1b7-4b2e-97e0-a7da574b4edb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:03.039053 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-0812a2be-a1b7-4b2e-97e0-a7da574b4edb tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 200 len: 1293 microversion: 2.1 time: 0.114409 Jun 21 18:37:03.039719 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 319/647] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:02 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 1293 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:37:04.064480 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2344df4d-616e-41ab-bee6-4d7364d119aa tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:04.065832 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-2344df4d-616e-41ab-bee6-4d7364d119aa tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:04.082277 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2344df4d-616e-41ab-bee6-4d7364d119aa tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:04.083489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2344df4d-616e-41ab-bee6-4d7364d119aa tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:04.084952 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2344df4d-616e-41ab-bee6-4d7364d119aa tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:04.086007 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2344df4d-616e-41ab-bee6-4d7364d119aa tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:04.330040 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2344df4d-616e-41ab-bee6-4d7364d119aa tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:04.345274 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-2344df4d-616e-41ab-bee6-4d7364d119aa tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 200 len: 1367 microversion: 2.1 time: 0.288340 Jun 21 18:37:04.347163 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 329/648] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:04 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:37:05.138441 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-e2aec091-22e2-4393-a723-1e52ba83bcb6 req-8198cf08-b1c9-4203-bdae-4a65b04e32ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "095e34aa-ee35-4453-b440-559af6d24823", "tag": "b5836f02-f91c-4847-a499-ae60785f7508"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:37:05.167607 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-e2aec091-22e2-4393-a723-1e52ba83bcb6 req-8198cf08-b1c9-4203-bdae-4a65b04e32ca service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:05.168712 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-e2aec091-22e2-4393-a723-1e52ba83bcb6 req-8198cf08-b1c9-4203-bdae-4a65b04e32ca service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:05.192697 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-e2aec091-22e2-4393-a723-1e52ba83bcb6 req-8198cf08-b1c9-4203-bdae-4a65b04e32ca service nova] Creating event network-changed:b5836f02-f91c-4847-a499-ae60785f7508 for instance 095e34aa-ee35-4453-b440-559af6d24823 on hv-cinder-84460 Jun 21 18:37:05.201141 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-e2aec091-22e2-4393-a723-1e52ba83bcb6 req-8198cf08-b1c9-4203-bdae-4a65b04e32ca service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070165 Jun 21 18:37:05.202293 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 320/649] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:37:05.368466 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f9b37e4a-3ec7-4a3e-82ea-29beb62712ed tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:05.369511 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f9b37e4a-3ec7-4a3e-82ea-29beb62712ed tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:05.380428 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f9b37e4a-3ec7-4a3e-82ea-29beb62712ed tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:05.381302 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f9b37e4a-3ec7-4a3e-82ea-29beb62712ed tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:05.382537 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f9b37e4a-3ec7-4a3e-82ea-29beb62712ed tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:05.383305 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f9b37e4a-3ec7-4a3e-82ea-29beb62712ed tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:05.583139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f9b37e4a-3ec7-4a3e-82ea-29beb62712ed tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:05.598030 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f9b37e4a-3ec7-4a3e-82ea-29beb62712ed tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 200 len: 1367 microversion: 2.1 time: 0.235781 Jun 21 18:37:05.599096 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 330/650] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:05 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:37:06.629149 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-3c4935f6-9679-4812-8549-1e7ce6bad275 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:06.630409 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-3c4935f6-9679-4812-8549-1e7ce6bad275 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:06.643509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3c4935f6-9679-4812-8549-1e7ce6bad275 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:06.644295 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3c4935f6-9679-4812-8549-1e7ce6bad275 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:06.645666 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3c4935f6-9679-4812-8549-1e7ce6bad275 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:06.646443 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3c4935f6-9679-4812-8549-1e7ce6bad275 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:06.834929 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-3c4935f6-9679-4812-8549-1e7ce6bad275 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:06.852316 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-3c4935f6-9679-4812-8549-1e7ce6bad275 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 200 len: 1367 microversion: 2.1 time: 0.231558 Jun 21 18:37:06.853476 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 321/651] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:06 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:07.878492 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-cae32683-2281-4745-b478-a828d9cb7140 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:07.879298 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-cae32683-2281-4745-b478-a828d9cb7140 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:07.887765 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cae32683-2281-4745-b478-a828d9cb7140 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:07.888237 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cae32683-2281-4745-b478-a828d9cb7140 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:07.889096 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cae32683-2281-4745-b478-a828d9cb7140 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:07.889557 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cae32683-2281-4745-b478-a828d9cb7140 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:08.056282 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-cae32683-2281-4745-b478-a828d9cb7140 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:08.067274 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-cae32683-2281-4745-b478-a828d9cb7140 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 200 len: 1367 microversion: 2.1 time: 0.193440 Jun 21 18:37:08.067995 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 331/652] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:07 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:09.089188 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-88e2c889-3199-445e-a5a3-6fd77ceb2a18 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:09.089932 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-88e2c889-3199-445e-a5a3-6fd77ceb2a18 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:09.092703 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:37:09.098718 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-88e2c889-3199-445e-a5a3-6fd77ceb2a18 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:09.099158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-88e2c889-3199-445e-a5a3-6fd77ceb2a18 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:09.099938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-88e2c889-3199-445e-a5a3-6fd77ceb2a18 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:09.100446 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-88e2c889-3199-445e-a5a3-6fd77ceb2a18 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:09.278703 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-88e2c889-3199-445e-a5a3-6fd77ceb2a18 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:09.293009 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-88e2c889-3199-445e-a5a3-6fd77ceb2a18 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 200 len: 1367 microversion: 2.1 time: 0.208143 Jun 21 18:37:09.294082 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 322/653] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:09 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:10.323929 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-cbde802f-f823-457b-8194-62ed0ff98a81 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:10.324609 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-cbde802f-f823-457b-8194-62ed0ff98a81 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:10.327481 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:37:10.334888 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cbde802f-f823-457b-8194-62ed0ff98a81 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:10.335408 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cbde802f-f823-457b-8194-62ed0ff98a81 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:10.336404 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cbde802f-f823-457b-8194-62ed0ff98a81 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:10.336919 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cbde802f-f823-457b-8194-62ed0ff98a81 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:10.498053 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-cbde802f-f823-457b-8194-62ed0ff98a81 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:10.506635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-cbde802f-f823-457b-8194-62ed0ff98a81 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 200 len: 1367 microversion: 2.1 time: 0.186721 Jun 21 18:37:10.507256 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 332/654] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:10 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:11.526527 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e7e84529-041b-4e0d-ae34-0ce33ada3120 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:11.527590 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e7e84529-041b-4e0d-ae34-0ce33ada3120 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:11.540174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e7e84529-041b-4e0d-ae34-0ce33ada3120 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:11.540692 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e7e84529-041b-4e0d-ae34-0ce33ada3120 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:11.541539 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e7e84529-041b-4e0d-ae34-0ce33ada3120 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:11.542051 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e7e84529-041b-4e0d-ae34-0ce33ada3120 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:11.693929 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=2 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:37:11.718255 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e7e84529-041b-4e0d-ae34-0ce33ada3120 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:11.720843 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=6 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:37:11.727952 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e7e84529-041b-4e0d-ae34-0ce33ada3120 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 200 len: 1367 microversion: 2.1 time: 0.206514 Jun 21 18:37:11.728596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 323/655] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:11 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:12.750590 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-74f7c2db-530e-4b44-985d-81bcacb35138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:12.751597 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-74f7c2db-530e-4b44-985d-81bcacb35138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:12.755166 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=6 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:37:12.763670 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-74f7c2db-530e-4b44-985d-81bcacb35138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:12.764217 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-74f7c2db-530e-4b44-985d-81bcacb35138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:12.765100 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-74f7c2db-530e-4b44-985d-81bcacb35138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:12.765759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-74f7c2db-530e-4b44-985d-81bcacb35138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:12.865683 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-bcfb8092-acc6-4ed3-9575-2c1a0cf15a6c req-fabde278-ee96-47e9-9a67-f3751038fd3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "095e34aa-ee35-4453-b440-559af6d24823", "name": "network-vif-plugged", "status": "completed", "tag": "b5836f02-f91c-4847-a499-ae60785f7508"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:37:12.884883 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-bcfb8092-acc6-4ed3-9575-2c1a0cf15a6c req-fabde278-ee96-47e9-9a67-f3751038fd3d service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:12.885688 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-bcfb8092-acc6-4ed3-9575-2c1a0cf15a6c req-fabde278-ee96-47e9-9a67-f3751038fd3d service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:12.910967 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-bcfb8092-acc6-4ed3-9575-2c1a0cf15a6c req-fabde278-ee96-47e9-9a67-f3751038fd3d service nova] Creating event network-vif-plugged:b5836f02-f91c-4847-a499-ae60785f7508 for instance 095e34aa-ee35-4453-b440-559af6d24823 on hv-cinder-84460 Jun 21 18:37:12.920910 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-bcfb8092-acc6-4ed3-9575-2c1a0cf15a6c req-fabde278-ee96-47e9-9a67-f3751038fd3d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060110 Jun 21 18:37:12.922436 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 324/656] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:37:12.978889 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-74f7c2db-530e-4b44-985d-81bcacb35138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:12.990744 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-74f7c2db-530e-4b44-985d-81bcacb35138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 200 len: 1367 microversion: 2.1 time: 0.246596 Jun 21 18:37:12.991362 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 333/657] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:12 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:14.020804 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a678b34f-843e-4be6-ac44-380cb7f52875 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:14.021401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-a678b34f-843e-4be6-ac44-380cb7f52875 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:14.029044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a678b34f-843e-4be6-ac44-380cb7f52875 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:14.029488 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a678b34f-843e-4be6-ac44-380cb7f52875 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:14.030455 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a678b34f-843e-4be6-ac44-380cb7f52875 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:14.030862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a678b34f-843e-4be6-ac44-380cb7f52875 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:14.189100 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-a678b34f-843e-4be6-ac44-380cb7f52875 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:14.197935 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a678b34f-843e-4be6-ac44-380cb7f52875 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 200 len: 1367 microversion: 2.1 time: 0.181820 Jun 21 18:37:14.198554 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 325/658] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:14 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:15.216650 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1b8a8b50-e83a-4956-9ec4-051cdb444293 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:15.217429 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1b8a8b50-e83a-4956-9ec4-051cdb444293 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:15.225494 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b8a8b50-e83a-4956-9ec4-051cdb444293 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:15.225963 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b8a8b50-e83a-4956-9ec4-051cdb444293 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:15.226741 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b8a8b50-e83a-4956-9ec4-051cdb444293 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:15.227197 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b8a8b50-e83a-4956-9ec4-051cdb444293 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:15.390454 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1b8a8b50-e83a-4956-9ec4-051cdb444293 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:15.399319 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1b8a8b50-e83a-4956-9ec4-051cdb444293 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 200 len: 1557 microversion: 2.1 time: 0.186934 Jun 21 18:37:15.399972 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 334/659] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:15 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 1557 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:15.417178 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2e6daa7c-f1f5-49ce-8f8b-1b93f6162ef7 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:15.418105 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-2e6daa7c-f1f5-49ce-8f8b-1b93f6162ef7 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:15.425788 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e6daa7c-f1f5-49ce-8f8b-1b93f6162ef7 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:15.426235 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e6daa7c-f1f5-49ce-8f8b-1b93f6162ef7 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:15.427016 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e6daa7c-f1f5-49ce-8f8b-1b93f6162ef7 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:15.427446 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2e6daa7c-f1f5-49ce-8f8b-1b93f6162ef7 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:15.521824 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2e6daa7c-f1f5-49ce-8f8b-1b93f6162ef7 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108210 Jun 21 18:37:15.522512 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 326/660] 10.222.0.87 () {58 vars in 1274 bytes} [Tue Jun 21 18:37:15 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:37:16.946947 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-269abe66-1f7b-4839-8ac5-c38a92d6aa6f req-47fe464e-0614-4425-bc24-9b1362e6c67a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "095e34aa-ee35-4453-b440-559af6d24823", "tag": "b5836f02-f91c-4847-a499-ae60785f7508"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:37:16.963839 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-269abe66-1f7b-4839-8ac5-c38a92d6aa6f req-47fe464e-0614-4425-bc24-9b1362e6c67a service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:16.964968 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-269abe66-1f7b-4839-8ac5-c38a92d6aa6f req-47fe464e-0614-4425-bc24-9b1362e6c67a service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:16.985471 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-269abe66-1f7b-4839-8ac5-c38a92d6aa6f req-47fe464e-0614-4425-bc24-9b1362e6c67a service nova] Creating event network-changed:b5836f02-f91c-4847-a499-ae60785f7508 for instance 095e34aa-ee35-4453-b440-559af6d24823 on hv-cinder-84460 Jun 21 18:37:16.993607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-269abe66-1f7b-4839-8ac5-c38a92d6aa6f req-47fe464e-0614-4425-bc24-9b1362e6c67a service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053770 Jun 21 18:37:16.994474 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 335/661] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:37:33.607908 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=9 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:37:33.608797 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:37:33.614372 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6cd112e4-6112-4bcb-9cdf-1fc56e0083dc tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:37:33.615389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-6cd112e4-6112-4bcb-9cdf-1fc56e0083dc tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:33.623639 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6cd112e4-6112-4bcb-9cdf-1fc56e0083dc tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:33.624230 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6cd112e4-6112-4bcb-9cdf-1fc56e0083dc tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:33.625124 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6cd112e4-6112-4bcb-9cdf-1fc56e0083dc tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:33.625675 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6cd112e4-6112-4bcb-9cdf-1fc56e0083dc tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:33.721840 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6cd112e4-6112-4bcb-9cdf-1fc56e0083dc tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "POST /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580/action" status: 202 len: 0 microversion: 2.1 time: 0.115193 Jun 21 18:37:33.722687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 327/662] 10.222.0.87 () {60 vars in 1277 bytes} [Tue Jun 21 18:37:33 2022] POST /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:37:33.733305 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=7 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:37:33.735016 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=52 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:37:33.745818 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-0895b301-3345-4f97-8b44-829ac5ef359b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:33.747297 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-0895b301-3345-4f97-8b44-829ac5ef359b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:33.762362 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0895b301-3345-4f97-8b44-829ac5ef359b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:33.763308 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0895b301-3345-4f97-8b44-829ac5ef359b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:33.764685 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0895b301-3345-4f97-8b44-829ac5ef359b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:33.765482 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0895b301-3345-4f97-8b44-829ac5ef359b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:33.977975 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-0895b301-3345-4f97-8b44-829ac5ef359b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:33.988138 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-0895b301-3345-4f97-8b44-829ac5ef359b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1750 microversion: 2.1 time: 0.258068 Jun 21 18:37:33.988739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 336/663] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:33 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1750 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:34.755723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-07171ca3-bd7d-4815-bcd6-294fc2319c7a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:34.756431 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-07171ca3-bd7d-4815-bcd6-294fc2319c7a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:34.764208 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-07171ca3-bd7d-4815-bcd6-294fc2319c7a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:34.764709 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-07171ca3-bd7d-4815-bcd6-294fc2319c7a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:34.765511 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-07171ca3-bd7d-4815-bcd6-294fc2319c7a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:34.765985 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-07171ca3-bd7d-4815-bcd6-294fc2319c7a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:34.882835 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.objects.instance [None req-07171ca3-bd7d-4815-bcd6-294fc2319c7a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lazy-loading 'services' on Instance uuid 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc {{(pid=118108) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:37:34.984798 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-07171ca3-bd7d-4815-bcd6-294fc2319c7a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "DELETE /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/os-volume_attachments/8a3192c1-8650-4f6a-afd5-2bd25f3ca609" status: 202 len: 0 microversion: 2.1 time: 0.234563 Jun 21 18:37:34.985497 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 328/664] 10.222.0.87 () {58 vars in 1415 bytes} [Tue Jun 21 18:37:34 2022] DELETE /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/os-volume_attachments/8a3192c1-8650-4f6a-afd5-2bd25f3ca609 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:37:34.995656 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-180785cb-d9b1-437c-a62a-c1fe73b4bad9 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:34.997560 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-180785cb-d9b1-437c-a62a-c1fe73b4bad9 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:35.007891 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-180785cb-d9b1-437c-a62a-c1fe73b4bad9 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:35.008608 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-180785cb-d9b1-437c-a62a-c1fe73b4bad9 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:35.009870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-180785cb-d9b1-437c-a62a-c1fe73b4bad9 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:35.011674 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-180785cb-d9b1-437c-a62a-c1fe73b4bad9 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:35.014072 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-93c18565-eed5-4469-b384-e26d06d05027 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:35.015122 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-93c18565-eed5-4469-b384-e26d06d05027 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:35.027690 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-93c18565-eed5-4469-b384-e26d06d05027 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:35.028453 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-93c18565-eed5-4469-b384-e26d06d05027 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:35.029730 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-93c18565-eed5-4469-b384-e26d06d05027 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:35.030470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-93c18565-eed5-4469-b384-e26d06d05027 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:35.060761 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-180785cb-d9b1-437c-a62a-c1fe73b4bad9 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070098 Jun 21 18:37:35.061361 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 337/665] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:37:34 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:37:35.247991 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-93c18565-eed5-4469-b384-e26d06d05027 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:35.257256 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-93c18565-eed5-4469-b384-e26d06d05027 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1755 microversion: 2.1 time: 0.252030 Jun 21 18:37:35.257901 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 329/666] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:35 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1755 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:36.077877 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ba6368e0-af9f-44b8-8a27-d13e04e420a2 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:36.079560 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ba6368e0-af9f-44b8-8a27-d13e04e420a2 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:36.092635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ba6368e0-af9f-44b8-8a27-d13e04e420a2 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:36.093331 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ba6368e0-af9f-44b8-8a27-d13e04e420a2 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:36.094882 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ba6368e0-af9f-44b8-8a27-d13e04e420a2 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:36.095404 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ba6368e0-af9f-44b8-8a27-d13e04e420a2 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:36.141080 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ba6368e0-af9f-44b8-8a27-d13e04e420a2 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071385 Jun 21 18:37:36.141887 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 338/667] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:37:36 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:37:36.276407 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-29e9f7e6-17b5-4a80-8bac-d29b6eed884a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:36.277127 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-29e9f7e6-17b5-4a80-8bac-d29b6eed884a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:36.287410 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-29e9f7e6-17b5-4a80-8bac-d29b6eed884a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:36.288042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-29e9f7e6-17b5-4a80-8bac-d29b6eed884a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:36.289288 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-29e9f7e6-17b5-4a80-8bac-d29b6eed884a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:36.290162 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-29e9f7e6-17b5-4a80-8bac-d29b6eed884a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:36.500434 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-29e9f7e6-17b5-4a80-8bac-d29b6eed884a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:36.511489 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-29e9f7e6-17b5-4a80-8bac-d29b6eed884a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1755 microversion: 2.1 time: 0.239076 Jun 21 18:37:36.512266 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 330/668] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:36 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1755 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:37.153860 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2de3a7b1-2c82-45e5-9f13-4e143c751dea tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:37.154780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-2de3a7b1-2c82-45e5-9f13-4e143c751dea tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:37.171376 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2de3a7b1-2c82-45e5-9f13-4e143c751dea tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:37.172189 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2de3a7b1-2c82-45e5-9f13-4e143c751dea tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:37.173453 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2de3a7b1-2c82-45e5-9f13-4e143c751dea tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:37.174252 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2de3a7b1-2c82-45e5-9f13-4e143c751dea tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:37.220775 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-2de3a7b1-2c82-45e5-9f13-4e143c751dea tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071234 Jun 21 18:37:37.221799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 339/669] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:37:37 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 18:37:37.325292 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-69e45a8c-5acb-46bd-b68c-a6835fb0cd8e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:37.326238 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-69e45a8c-5acb-46bd-b68c-a6835fb0cd8e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:37.339035 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-69e45a8c-5acb-46bd-b68c-a6835fb0cd8e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:37.339906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-69e45a8c-5acb-46bd-b68c-a6835fb0cd8e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:37.341276 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-69e45a8c-5acb-46bd-b68c-a6835fb0cd8e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:37.342075 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-69e45a8c-5acb-46bd-b68c-a6835fb0cd8e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:37.377113 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-69e45a8c-5acb-46bd-b68c-a6835fb0cd8e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Going to try to terminate instance {{(pid=118108) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:37:37.498711 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-69e45a8c-5acb-46bd-b68c-a6835fb0cd8e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "DELETE /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 204 len: 0 microversion: 2.1 time: 0.180540 Jun 21 18:37:37.499543 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 331/670] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:37:37 2022] DELETE /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:37:37.508471 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a035b095-df41-484a-8eef-de67fa73ba91 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:37.509307 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-a035b095-df41-484a-8eef-de67fa73ba91 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:37.516976 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a035b095-df41-484a-8eef-de67fa73ba91 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:37.517525 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a035b095-df41-484a-8eef-de67fa73ba91 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:37.518388 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a035b095-df41-484a-8eef-de67fa73ba91 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:37.518851 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a035b095-df41-484a-8eef-de67fa73ba91 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:37.533330 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d2dc0bc6-b859-4a6a-aeb2-4a701665eb40 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:37.534511 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-d2dc0bc6-b859-4a6a-aeb2-4a701665eb40 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:37.546652 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d2dc0bc6-b859-4a6a-aeb2-4a701665eb40 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:37.547373 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d2dc0bc6-b859-4a6a-aeb2-4a701665eb40 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:37.548706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d2dc0bc6-b859-4a6a-aeb2-4a701665eb40 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:37.549406 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d2dc0bc6-b859-4a6a-aeb2-4a701665eb40 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:37.804638 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-a035b095-df41-484a-8eef-de67fa73ba91 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:37.818947 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-a035b095-df41-484a-8eef-de67fa73ba91 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1690 microversion: 2.1 time: 0.314124 Jun 21 18:37:37.820377 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 340/671] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:37 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1690 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:37.852074 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-d2dc0bc6-b859-4a6a-aeb2-4a701665eb40 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:37.867248 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-d2dc0bc6-b859-4a6a-aeb2-4a701665eb40 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1755 microversion: 2.1 time: 0.340287 Jun 21 18:37:37.868889 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 332/672] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:37 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1755 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:37:38.838705 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-5eb4a7f7-510a-4aa8-9120-062d3f19b4e8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:38.839787 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-5eb4a7f7-510a-4aa8-9120-062d3f19b4e8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:38.847790 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5eb4a7f7-510a-4aa8-9120-062d3f19b4e8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:38.848166 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5eb4a7f7-510a-4aa8-9120-062d3f19b4e8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:38.848963 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5eb4a7f7-510a-4aa8-9120-062d3f19b4e8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:38.849389 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5eb4a7f7-510a-4aa8-9120-062d3f19b4e8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:38.896280 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2a5ecdb4-b9cb-49b4-80b4-bc3cdc69b90f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:38.897168 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-2a5ecdb4-b9cb-49b4-80b4-bc3cdc69b90f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:38.905686 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2a5ecdb4-b9cb-49b4-80b4-bc3cdc69b90f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:38.906389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2a5ecdb4-b9cb-49b4-80b4-bc3cdc69b90f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:38.907372 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2a5ecdb4-b9cb-49b4-80b4-bc3cdc69b90f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:38.907998 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2a5ecdb4-b9cb-49b4-80b4-bc3cdc69b90f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:39.200908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-5eb4a7f7-510a-4aa8-9120-062d3f19b4e8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:39.215535 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-5eb4a7f7-510a-4aa8-9120-062d3f19b4e8 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1690 microversion: 2.1 time: 0.381140 Jun 21 18:37:39.216639 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 341/673] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:38 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1690 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:37:39.253735 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2a5ecdb4-b9cb-49b4-80b4-bc3cdc69b90f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:39.269257 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2a5ecdb4-b9cb-49b4-80b4-bc3cdc69b90f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1755 microversion: 2.1 time: 0.378460 Jun 21 18:37:39.270375 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 333/674] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:38 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1755 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:37:40.245369 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6d057c45-73c4-439c-86b8-a8a7b6027915 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:40.246491 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6d057c45-73c4-439c-86b8-a8a7b6027915 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:40.258880 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6d057c45-73c4-439c-86b8-a8a7b6027915 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:40.259631 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6d057c45-73c4-439c-86b8-a8a7b6027915 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:40.261088 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6d057c45-73c4-439c-86b8-a8a7b6027915 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:40.261888 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6d057c45-73c4-439c-86b8-a8a7b6027915 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:40.292649 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e3653967-ba60-4e5a-b8a8-0bfdaed06095 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:40.293663 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e3653967-ba60-4e5a-b8a8-0bfdaed06095 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:40.305387 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e3653967-ba60-4e5a-b8a8-0bfdaed06095 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:40.306144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e3653967-ba60-4e5a-b8a8-0bfdaed06095 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:40.307546 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e3653967-ba60-4e5a-b8a8-0bfdaed06095 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:40.308306 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e3653967-ba60-4e5a-b8a8-0bfdaed06095 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:40.786877 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-6d057c45-73c4-439c-86b8-a8a7b6027915 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:40.800883 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6d057c45-73c4-439c-86b8-a8a7b6027915 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1690 microversion: 2.1 time: 0.562654 Jun 21 18:37:40.801952 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 342/675] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:40 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1690 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:40.843319 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e3653967-ba60-4e5a-b8a8-0bfdaed06095 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:40.859463 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e3653967-ba60-4e5a-b8a8-0bfdaed06095 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1755 microversion: 2.1 time: 0.573323 Jun 21 18:37:40.860495 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 334/676] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:40 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1755 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:37:41.827258 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-044b3a0c-46af-4fd8-be67-4ec7bee1c06a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:41.827918 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-044b3a0c-46af-4fd8-be67-4ec7bee1c06a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:41.835764 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-044b3a0c-46af-4fd8-be67-4ec7bee1c06a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:41.836360 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-044b3a0c-46af-4fd8-be67-4ec7bee1c06a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:41.837632 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-044b3a0c-46af-4fd8-be67-4ec7bee1c06a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:41.838357 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-044b3a0c-46af-4fd8-be67-4ec7bee1c06a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:41.882506 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b0916505-8bcc-4fe7-a291-b8322765fc62 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:41.883691 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b0916505-8bcc-4fe7-a291-b8322765fc62 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:41.895920 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b0916505-8bcc-4fe7-a291-b8322765fc62 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:41.897903 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b0916505-8bcc-4fe7-a291-b8322765fc62 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:41.898291 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b0916505-8bcc-4fe7-a291-b8322765fc62 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:41.900715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b0916505-8bcc-4fe7-a291-b8322765fc62 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:42.098519 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-044b3a0c-46af-4fd8-be67-4ec7bee1c06a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:42.113677 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-044b3a0c-46af-4fd8-be67-4ec7bee1c06a tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1690 microversion: 2.1 time: 0.289926 Jun 21 18:37:42.114620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 343/677] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:41 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1690 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:42.206859 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-b0916505-8bcc-4fe7-a291-b8322765fc62 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:42.217813 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b0916505-8bcc-4fe7-a291-b8322765fc62 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1755 microversion: 2.1 time: 0.342589 Jun 21 18:37:42.218569 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 335/678] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:41 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1755 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:37:43.138185 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-cc162538-caf7-4357-9b68-267937a2b996 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:43.140253 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-cc162538-caf7-4357-9b68-267937a2b996 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:43.152126 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cc162538-caf7-4357-9b68-267937a2b996 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:43.154328 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cc162538-caf7-4357-9b68-267937a2b996 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:43.155818 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cc162538-caf7-4357-9b68-267937a2b996 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:43.156856 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cc162538-caf7-4357-9b68-267937a2b996 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:43.245106 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-cf1f10b2-b96c-4ab1-9ec8-5c470286403f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:43.252056 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-cf1f10b2-b96c-4ab1-9ec8-5c470286403f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:43.265123 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cf1f10b2-b96c-4ab1-9ec8-5c470286403f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:43.266764 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cf1f10b2-b96c-4ab1-9ec8-5c470286403f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:43.268610 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cf1f10b2-b96c-4ab1-9ec8-5c470286403f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:43.269687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cf1f10b2-b96c-4ab1-9ec8-5c470286403f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:43.305069 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-cc162538-caf7-4357-9b68-267937a2b996 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:43.319401 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-cc162538-caf7-4357-9b68-267937a2b996 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 200 len: 1622 microversion: 2.1 time: 0.188763 Jun 21 18:37:43.321210 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 344/679] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:43 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 1622 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:43.331408 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-8503af5c-64ea-4273-8168-0fa9613fa15e req-3cd7681a-c752-4f70-b143-afe318d03975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a2aebe7-f120-48fd-8aa0-7e91b857e1cc", "name": "network-vif-deleted", "tag": "fbfe0125-66e4-4f30-a67a-e407b7aed936"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:37:43.348019 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-8503af5c-64ea-4273-8168-0fa9613fa15e req-3cd7681a-c752-4f70-b143-afe318d03975 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:43.349163 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-8503af5c-64ea-4273-8168-0fa9613fa15e req-3cd7681a-c752-4f70-b143-afe318d03975 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:43.371954 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-8503af5c-64ea-4273-8168-0fa9613fa15e req-3cd7681a-c752-4f70-b143-afe318d03975 service nova] Creating event network-vif-deleted:fbfe0125-66e4-4f30-a67a-e407b7aed936 for instance 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc on hv-cinder-84460 Jun 21 18:37:43.387932 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-8503af5c-64ea-4273-8168-0fa9613fa15e req-3cd7681a-c752-4f70-b143-afe318d03975 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064684 Jun 21 18:37:43.388572 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 345/680] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:37:43.560164 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-cf1f10b2-b96c-4ab1-9ec8-5c470286403f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:43.569440 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-cf1f10b2-b96c-4ab1-9ec8-5c470286403f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1755 microversion: 2.1 time: 0.331634 Jun 21 18:37:43.570094 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 336/681] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:43 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1755 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:44.343400 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bc75c766-a4cc-4865-9bd7-dd7758613014 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:44.344476 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-bc75c766-a4cc-4865-9bd7-dd7758613014 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:44.352623 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bc75c766-a4cc-4865-9bd7-dd7758613014 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:44.353295 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bc75c766-a4cc-4865-9bd7-dd7758613014 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:44.354977 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bc75c766-a4cc-4865-9bd7-dd7758613014 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:44.355537 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bc75c766-a4cc-4865-9bd7-dd7758613014 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:44.377934 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-bc75c766-a4cc-4865-9bd7-dd7758613014 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] HTTP exception thrown: Instance 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc could not be found. Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bc75c766-a4cc-4865-9bd7-dd7758613014 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Request method failure captured: Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc HTTP/1.1 Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg3_Pnx5ZJZEy_IdO1FVKKz0eLIc_62ltL3NJ6cmKflv6yZyt7QxyJvFplTihWds8VBITWE0yiTGANcSfrrGMK4zcFgLYB379BkRv2UsJO-YDM9lyF0_DS77njTRdJg7kVpdIgc_ghlZeUGuKsri6aMYf7i959Igr4Q6i6zwhEftaP4 Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 6538654ef94d4036a7a8d5614b80b0ed Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-813750082 Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:37:44.380635 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:37:44.383607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:37:44.383607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-ServerRescueNegativeTestJSON-813750082 Jun 21 18:37:44.383607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 6538654ef94d4036a7a8d5614b80b0ed Jun 21 18:37:44.383607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-813750082 Jun 21 18:37:44.383607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-ServerRescueNegativeTestJSON-813750082-project Jun 21 18:37:44.383607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:37:44.383607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:37:44.383607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: de09b91800314d06aeddafe3c12a77b3 Jun 21 18:37:44.383607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-ServerRescueNegativeTestJSON-813750082-project Jun 21 18:37:44.383607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:37:44.383607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc could not be found. Jun 21 18:37:44.383607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': '0a2aebe7-f120-48fd-8aa0-7e91b857e1cc'} Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc could not be found. Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:37:44.385139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:37:44.387900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:37:44.387900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:37:44.387900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:37:44.387900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:37:44.387900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:37:44.387900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:37:44.387900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:37:44.387900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc could not be found. Jun 21 18:37:44.387900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:37:44.387900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:37:44.387900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:37:44.387900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:37:44.387900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:37:44.387900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:37:44.387900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:37:44.387900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:37:44.387900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc could not be found. Jun 21 18:37:44.387900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:37:44.390105 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bc75c766-a4cc-4865-9bd7-dd7758613014 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Returning 404 to user: Instance 0a2aebe7-f120-48fd-8aa0-7e91b857e1cc could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:37:44.390105 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-bc75c766-a4cc-4865-9bd7-dd7758613014 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc" status: 404 len: 111 microversion: 2.1 time: 0.047406 Jun 21 18:37:44.390105 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 346/682] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:44 2022] GET /compute/v2.1/servers/0a2aebe7-f120-48fd-8aa0-7e91b857e1cc => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:37:44.396389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d29bccfa-9704-4829-ab8c-33755a803e1b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '.version_select at 0x7fd8b80fdd30>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:44.422530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-d29bccfa-9704-4829-ab8c-33755a803e1b tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480547835" status: 202 len: 0 microversion: 2.1 time: 0.031375 Jun 21 18:37:44.423532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 337/683] 10.222.0.87 () {58 vars in 1220 bytes} [Tue Jun 21 18:37:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480547835 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:37:44.593875 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-59bba6e5-b0ed-4bdc-b79e-1fa13df7ed98 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:44.595168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-59bba6e5-b0ed-4bdc-b79e-1fa13df7ed98 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:44.607896 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-59bba6e5-b0ed-4bdc-b79e-1fa13df7ed98 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:44.609235 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-59bba6e5-b0ed-4bdc-b79e-1fa13df7ed98 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:44.610875 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-59bba6e5-b0ed-4bdc-b79e-1fa13df7ed98 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:44.611771 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-59bba6e5-b0ed-4bdc-b79e-1fa13df7ed98 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:44.921701 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-59bba6e5-b0ed-4bdc-b79e-1fa13df7ed98 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:44.942436 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-59bba6e5-b0ed-4bdc-b79e-1fa13df7ed98 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1755 microversion: 2.1 time: 0.357410 Jun 21 18:37:44.949145 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 347/684] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:44 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1755 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:45.971096 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-ae5da7ad-9d40-406c-a3df-109a05e67c0b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:45.972129 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-ae5da7ad-9d40-406c-a3df-109a05e67c0b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:45.981841 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ae5da7ad-9d40-406c-a3df-109a05e67c0b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:45.982380 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ae5da7ad-9d40-406c-a3df-109a05e67c0b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:45.983934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ae5da7ad-9d40-406c-a3df-109a05e67c0b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:45.984547 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ae5da7ad-9d40-406c-a3df-109a05e67c0b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:46.203234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ae5da7ad-9d40-406c-a3df-109a05e67c0b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:46.219382 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-ae5da7ad-9d40-406c-a3df-109a05e67c0b tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1755 microversion: 2.1 time: 0.252439 Jun 21 18:37:46.220397 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 338/685] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:45 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1755 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:47.247183 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-44af35dd-6f4f-4c5c-a2e1-f95d7e0ae27a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:47.247937 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-44af35dd-6f4f-4c5c-a2e1-f95d7e0ae27a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:47.255490 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-44af35dd-6f4f-4c5c-a2e1-f95d7e0ae27a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:47.255956 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-44af35dd-6f4f-4c5c-a2e1-f95d7e0ae27a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:47.256742 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-44af35dd-6f4f-4c5c-a2e1-f95d7e0ae27a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:47.257171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-44af35dd-6f4f-4c5c-a2e1-f95d7e0ae27a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:47.433349 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-44af35dd-6f4f-4c5c-a2e1-f95d7e0ae27a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:47.442013 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-44af35dd-6f4f-4c5c-a2e1-f95d7e0ae27a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1758 microversion: 2.1 time: 0.199470 Jun 21 18:37:47.442596 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 348/686] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:47 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1758 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:47.851827 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-1850fcd9-c275-42f1-8573-03a9ffea0ed7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:47.852753 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-1850fcd9-c275-42f1-8573-03a9ffea0ed7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:47.862115 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1850fcd9-c275-42f1-8573-03a9ffea0ed7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:47.862648 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1850fcd9-c275-42f1-8573-03a9ffea0ed7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:47.863658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1850fcd9-c275-42f1-8573-03a9ffea0ed7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:47.864151 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1850fcd9-c275-42f1-8573-03a9ffea0ed7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:47.895216 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-1850fcd9-c275-42f1-8573-03a9ffea0ed7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Going to try to terminate instance {{(pid=118108) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:37:47.951209 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:37:48.003279 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-1850fcd9-c275-42f1-8573-03a9ffea0ed7 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "DELETE /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 204 len: 0 microversion: 2.1 time: 0.157119 Jun 21 18:37:48.004438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 339/687] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:37:47 2022] DELETE /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 18:37:48.022029 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-7e04691b-56d6-415e-819c-b2374bb1293e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:48.022406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-7e04691b-56d6-415e-819c-b2374bb1293e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:48.029892 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7e04691b-56d6-415e-819c-b2374bb1293e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:48.030672 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7e04691b-56d6-415e-819c-b2374bb1293e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:48.031898 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7e04691b-56d6-415e-819c-b2374bb1293e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:48.032453 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7e04691b-56d6-415e-819c-b2374bb1293e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:48.239213 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-7e04691b-56d6-415e-819c-b2374bb1293e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:48.253026 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-7e04691b-56d6-415e-819c-b2374bb1293e tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1508 microversion: 2.1 time: 0.238563 Jun 21 18:37:48.254103 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 349/688] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:48 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:49.284864 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5fca3c37-6430-48d4-8981-1994ae2377fe tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:49.286219 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-5fca3c37-6430-48d4-8981-1994ae2377fe tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:49.299969 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5fca3c37-6430-48d4-8981-1994ae2377fe tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:49.300884 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5fca3c37-6430-48d4-8981-1994ae2377fe tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:49.302359 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5fca3c37-6430-48d4-8981-1994ae2377fe tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:49.303162 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5fca3c37-6430-48d4-8981-1994ae2377fe tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:49.543364 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-5fca3c37-6430-48d4-8981-1994ae2377fe tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:49.547325 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-c6b45cb3-574e-4c89-9517-c2e217d935fa req-411db4c5-a9ec-455a-9d63-5e8553d2dd2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f480e87-eeb9-47b0-95b8-f3ef475d2843", "name": "network-vif-deleted", "tag": "12b63897-fe8b-4cf4-a023-8abd752eef06"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:37:49.556879 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-5fca3c37-6430-48d4-8981-1994ae2377fe tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 200 len: 1508 microversion: 2.1 time: 0.279543 Jun 21 18:37:49.558391 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 340/689] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:49 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 1508 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:49.573017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-c6b45cb3-574e-4c89-9517-c2e217d935fa req-411db4c5-a9ec-455a-9d63-5e8553d2dd2f service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:49.573854 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-c6b45cb3-574e-4c89-9517-c2e217d935fa req-411db4c5-a9ec-455a-9d63-5e8553d2dd2f service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:49.597076 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-c6b45cb3-574e-4c89-9517-c2e217d935fa req-411db4c5-a9ec-455a-9d63-5e8553d2dd2f service nova] Creating event network-vif-deleted:12b63897-fe8b-4cf4-a023-8abd752eef06 for instance 9f480e87-eeb9-47b0-95b8-f3ef475d2843 on hv-cinder-84460 Jun 21 18:37:49.606955 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-c6b45cb3-574e-4c89-9517-c2e217d935fa req-411db4c5-a9ec-455a-9d63-5e8553d2dd2f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070599 Jun 21 18:37:49.608191 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 350/690] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:37:50.585970 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-bb5c793d-7630-4aa3-85bf-732276a6a0e0 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:50.587381 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-bb5c793d-7630-4aa3-85bf-732276a6a0e0 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: 9f480e87-eeb9-47b0-95b8-f3ef475d2843] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:50.600155 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bb5c793d-7630-4aa3-85bf-732276a6a0e0 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:50.600819 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bb5c793d-7630-4aa3-85bf-732276a6a0e0 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:50.602118 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bb5c793d-7630-4aa3-85bf-732276a6a0e0 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:50.602750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bb5c793d-7630-4aa3-85bf-732276a6a0e0 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:50.625370 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-bb5c793d-7630-4aa3-85bf-732276a6a0e0 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] HTTP exception thrown: Instance 9f480e87-eeb9-47b0-95b8-f3ef475d2843 could not be found. Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-bb5c793d-7630-4aa3-85bf-732276a6a0e0 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Request method failure captured: Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 HTTP/1.1 Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABisg3_Pnx5ZJZEy_IdO1FVKKz0eLIc_62ltL3NJ6cmKflv6yZyt7QxyJvFplTihWds8VBITWE0yiTGANcSfrrGMK4zcFgLYB379BkRv2UsJO-YDM9lyF0_DS77njTRdJg7kVpdIgc_ghlZeUGuKsri6aMYf7i959Igr4Q6i6zwhEftaP4 Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 6538654ef94d4036a7a8d5614b80b0ed Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-813750082 Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:37:50.627622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:37:50.630090 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:37:50.630090 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-ServerRescueNegativeTestJSON-813750082 Jun 21 18:37:50.630090 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 6538654ef94d4036a7a8d5614b80b0ed Jun 21 18:37:50.630090 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-813750082 Jun 21 18:37:50.630090 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-ServerRescueNegativeTestJSON-813750082-project Jun 21 18:37:50.630090 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:37:50.630090 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:37:50.630090 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: de09b91800314d06aeddafe3c12a77b3 Jun 21 18:37:50.630090 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-ServerRescueNegativeTestJSON-813750082-project Jun 21 18:37:50.630090 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:37:50.630090 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance 9f480e87-eeb9-47b0-95b8-f3ef475d2843 could not be found. Jun 21 18:37:50.630090 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': '9f480e87-eeb9-47b0-95b8-f3ef475d2843'} Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f480e87-eeb9-47b0-95b8-f3ef475d2843 could not be found. Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:37:50.631849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:37:50.634532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:37:50.634532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:37:50.634532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:37:50.634532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:37:50.634532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:37:50.634532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:37:50.634532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:37:50.634532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f480e87-eeb9-47b0-95b8-f3ef475d2843 could not be found. Jun 21 18:37:50.634532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:37:50.634532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:37:50.634532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:37:50.634532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:37:50.634532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:37:50.634532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:37:50.634532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:37:50.634532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:37:50.634532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f480e87-eeb9-47b0-95b8-f3ef475d2843 could not be found. Jun 21 18:37:50.634532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:37:50.636299 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-bb5c793d-7630-4aa3-85bf-732276a6a0e0 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Returning 404 to user: Instance 9f480e87-eeb9-47b0-95b8-f3ef475d2843 could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:37:50.636299 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-bb5c793d-7630-4aa3-85bf-732276a6a0e0 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843" status: 404 len: 111 microversion: 2.1 time: 0.049035 Jun 21 18:37:50.636299 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 341/691] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:50 2022] GET /compute/v2.1/servers/9f480e87-eeb9-47b0-95b8-f3ef475d2843 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:37:50.643633 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-606f9286-3e7a-4112-9f92-576d178752e3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:50.644278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-606f9286-3e7a-4112-9f92-576d178752e3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:50.651821 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-606f9286-3e7a-4112-9f92-576d178752e3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:50.652265 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-606f9286-3e7a-4112-9f92-576d178752e3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:50.653063 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-606f9286-3e7a-4112-9f92-576d178752e3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:50.653842 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-606f9286-3e7a-4112-9f92-576d178752e3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:50.689353 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-606f9286-3e7a-4112-9f92-576d178752e3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Going to try to terminate instance {{(pid=118109) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:37:50.826076 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-606f9286-3e7a-4112-9f92-576d178752e3 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 204 len: 0 microversion: 2.1 time: 0.187056 Jun 21 18:37:50.826962 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 351/692] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:37:50 2022] DELETE /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:37:50.844612 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4770b5e7-5faf-4760-97cc-47265c5d3ffb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:50.845855 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4770b5e7-5faf-4760-97cc-47265c5d3ffb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:50.857617 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4770b5e7-5faf-4760-97cc-47265c5d3ffb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:50.858923 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4770b5e7-5faf-4760-97cc-47265c5d3ffb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:50.860409 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4770b5e7-5faf-4760-97cc-47265c5d3ffb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:50.861198 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4770b5e7-5faf-4760-97cc-47265c5d3ffb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:51.081078 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-4770b5e7-5faf-4760-97cc-47265c5d3ffb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:51.096373 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4770b5e7-5faf-4760-97cc-47265c5d3ffb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1522 microversion: 2.1 time: 0.262902 Jun 21 18:37:51.097347 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 342/693] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:50 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:52.130552 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-d4fa1f43-bec4-4d7f-b251-db77bc963b23 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:52.132006 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-d4fa1f43-bec4-4d7f-b251-db77bc963b23 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:52.157151 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d4fa1f43-bec4-4d7f-b251-db77bc963b23 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:52.157972 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d4fa1f43-bec4-4d7f-b251-db77bc963b23 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:52.159334 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d4fa1f43-bec4-4d7f-b251-db77bc963b23 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:52.163790 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d4fa1f43-bec4-4d7f-b251-db77bc963b23 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:52.408006 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-d4fa1f43-bec4-4d7f-b251-db77bc963b23 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de09b91800314d06aeddafe3c12a77b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6538654ef94d4036a7a8d5614b80b0ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:52.414740 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:37:52.424872 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-d4fa1f43-bec4-4d7f-b251-db77bc963b23 tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 200 len: 1522 microversion: 2.1 time: 0.310501 Jun 21 18:37:52.426341 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 352/694] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:52 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:52.444506 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-bfa6cef8-97a6-4521-b22e-685de2f5944a req-4a16ed06-e663-4e3e-82bb-ffd3fc9f4a86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3e33553-dc4c-4e34-8533-beea14017592", "name": "network-vif-deleted", "tag": "d4836e08-d41b-4ef2-b2c0-250ffcd31fdb"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:37:52.457044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-bfa6cef8-97a6-4521-b22e-685de2f5944a req-4a16ed06-e663-4e3e-82bb-ffd3fc9f4a86 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:52.457678 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-bfa6cef8-97a6-4521-b22e-685de2f5944a req-4a16ed06-e663-4e3e-82bb-ffd3fc9f4a86 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:52.480976 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-bfa6cef8-97a6-4521-b22e-685de2f5944a req-4a16ed06-e663-4e3e-82bb-ffd3fc9f4a86 service nova] Creating event network-vif-deleted:d4836e08-d41b-4ef2-b2c0-250ffcd31fdb for instance c3e33553-dc4c-4e34-8533-beea14017592 on hv-cinder-84460 Jun 21 18:37:52.487091 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-bfa6cef8-97a6-4521-b22e-685de2f5944a req-4a16ed06-e663-4e3e-82bb-ffd3fc9f4a86 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050302 Jun 21 18:37:52.487916 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 343/695] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:37:53.452404 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-182ae98b-d783-421f-aef2-eadf292ce3bb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:53.453297 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-182ae98b-d783-421f-aef2-eadf292ce3bb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] [instance: c3e33553-dc4c-4e34-8533-beea14017592] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:53.461926 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-182ae98b-d783-421f-aef2-eadf292ce3bb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:53.462377 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-182ae98b-d783-421f-aef2-eadf292ce3bb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:53.463312 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-182ae98b-d783-421f-aef2-eadf292ce3bb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:53.463772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-182ae98b-d783-421f-aef2-eadf292ce3bb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:53.482970 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-182ae98b-d783-421f-aef2-eadf292ce3bb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] HTTP exception thrown: Instance c3e33553-dc4c-4e34-8533-beea14017592 could not be found. Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-182ae98b-d783-421f-aef2-eadf292ce3bb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Request method failure captured: Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 HTTP/1.1 Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg3_Pnx5ZJZEy_IdO1FVKKz0eLIc_62ltL3NJ6cmKflv6yZyt7QxyJvFplTihWds8VBITWE0yiTGANcSfrrGMK4zcFgLYB379BkRv2UsJO-YDM9lyF0_DS77njTRdJg7kVpdIgc_ghlZeUGuKsri6aMYf7i959Igr4Q6i6zwhEftaP4 Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 6538654ef94d4036a7a8d5614b80b0ed Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-813750082 Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:37:53.484894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:37:53.487624 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_6538654ef94d4036a7a8d5614b80b0ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:37:53.487624 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-ServerRescueNegativeTestJSON-813750082 Jun 21 18:37:53.487624 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 6538654ef94d4036a7a8d5614b80b0ed Jun 21 18:37:53.487624 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-813750082 Jun 21 18:37:53.487624 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-ServerRescueNegativeTestJSON-813750082-project Jun 21 18:37:53.487624 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:37:53.487624 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:37:53.487624 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: de09b91800314d06aeddafe3c12a77b3 Jun 21 18:37:53.487624 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-ServerRescueNegativeTestJSON-813750082-project Jun 21 18:37:53.487624 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:37:53.487624 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance c3e33553-dc4c-4e34-8533-beea14017592 could not be found. Jun 21 18:37:53.487624 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': 'c3e33553-dc4c-4e34-8533-beea14017592'} Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3e33553-dc4c-4e34-8533-beea14017592 could not be found. Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:37:53.489048 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:37:53.491625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:37:53.491625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:37:53.491625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:37:53.491625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:37:53.491625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:37:53.491625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:37:53.491625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:37:53.491625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3e33553-dc4c-4e34-8533-beea14017592 could not be found. Jun 21 18:37:53.491625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:37:53.491625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:37:53.491625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:37:53.491625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:37:53.491625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:37:53.491625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:37:53.491625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:37:53.491625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:37:53.491625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3e33553-dc4c-4e34-8533-beea14017592 could not be found. Jun 21 18:37:53.491625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:37:53.493813 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-182ae98b-d783-421f-aef2-eadf292ce3bb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] Returning 404 to user: Instance c3e33553-dc4c-4e34-8533-beea14017592 could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:37:53.493813 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-182ae98b-d783-421f-aef2-eadf292ce3bb tempest-ServerRescueNegativeTestJSON-813750082 tempest-ServerRescueNegativeTestJSON-813750082-project] 10.222.0.87 "GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592" status: 404 len: 111 microversion: 2.1 time: 0.040458 Jun 21 18:37:53.493813 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 353/696] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:53 2022] GET /compute/v2.1/servers/c3e33553-dc4c-4e34-8533-beea14017592 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 18:37:54.552123 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5377b712-0d3c-4fca-9cbc-8a355e5487e4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:54.553674 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-5377b712-0d3c-4fca-9cbc-8a355e5487e4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:54.564276 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5377b712-0d3c-4fca-9cbc-8a355e5487e4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:54.565031 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5377b712-0d3c-4fca-9cbc-8a355e5487e4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:54.566249 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5377b712-0d3c-4fca-9cbc-8a355e5487e4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:54.566870 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5377b712-0d3c-4fca-9cbc-8a355e5487e4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:54.619183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-5377b712-0d3c-4fca-9cbc-8a355e5487e4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073516 Jun 21 18:37:54.619881 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 344/697] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:37:54 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 18:37:54.708078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8c24ec01-f61e-4d96-b357-c5c8558ac91a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:54.709181 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8c24ec01-f61e-4d96-b357-c5c8558ac91a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:54.721218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8c24ec01-f61e-4d96-b357-c5c8558ac91a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:54.722069 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8c24ec01-f61e-4d96-b357-c5c8558ac91a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:54.723610 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8c24ec01-f61e-4d96-b357-c5c8558ac91a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:54.724324 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8c24ec01-f61e-4d96-b357-c5c8558ac91a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:54.781016 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8c24ec01-f61e-4d96-b357-c5c8558ac91a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Going to try to terminate instance {{(pid=118109) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:37:54.939835 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8c24ec01-f61e-4d96-b357-c5c8558ac91a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 204 len: 0 microversion: 2.1 time: 0.238693 Jun 21 18:37:54.941122 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 354/698] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:37:54 2022] DELETE /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:37:54.954362 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-fd4468c2-322d-431b-bfed-affbd74ed09b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:54.955557 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-fd4468c2-322d-431b-bfed-affbd74ed09b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:54.968727 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fd4468c2-322d-431b-bfed-affbd74ed09b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:54.969536 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fd4468c2-322d-431b-bfed-affbd74ed09b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:54.971140 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fd4468c2-322d-431b-bfed-affbd74ed09b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:54.971924 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fd4468c2-322d-431b-bfed-affbd74ed09b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:55.229689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-fd4468c2-322d-431b-bfed-affbd74ed09b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:55.249946 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-fd4468c2-322d-431b-bfed-affbd74ed09b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1673 microversion: 2.1 time: 0.301948 Jun 21 18:37:55.250791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 345/699] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:54 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1673 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:56.282334 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-744d1f7e-69a8-4d87-b538-ba8e6533e6f0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:56.283641 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-744d1f7e-69a8-4d87-b538-ba8e6533e6f0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:56.295624 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-744d1f7e-69a8-4d87-b538-ba8e6533e6f0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:56.296232 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-744d1f7e-69a8-4d87-b538-ba8e6533e6f0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:56.297125 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-744d1f7e-69a8-4d87-b538-ba8e6533e6f0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:56.297840 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-744d1f7e-69a8-4d87-b538-ba8e6533e6f0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:56.475982 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-744d1f7e-69a8-4d87-b538-ba8e6533e6f0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:56.485469 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-744d1f7e-69a8-4d87-b538-ba8e6533e6f0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1673 microversion: 2.1 time: 0.211473 Jun 21 18:37:56.486401 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 355/700] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:56 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1673 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:57.510011 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e854171d-d04c-443a-bcfe-251f1cd509ca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:57.512485 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e854171d-d04c-443a-bcfe-251f1cd509ca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:57.529582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e854171d-d04c-443a-bcfe-251f1cd509ca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:57.530507 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e854171d-d04c-443a-bcfe-251f1cd509ca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:57.532094 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e854171d-d04c-443a-bcfe-251f1cd509ca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:57.532981 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e854171d-d04c-443a-bcfe-251f1cd509ca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:57.802037 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e854171d-d04c-443a-bcfe-251f1cd509ca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:57.817111 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e854171d-d04c-443a-bcfe-251f1cd509ca tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1673 microversion: 2.1 time: 0.314720 Jun 21 18:37:57.818466 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 346/701] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:57 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1673 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:58.846385 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a33f1219-fc9d-4fb8-94f1-86070e189d57 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:37:58.847492 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-a33f1219-fc9d-4fb8-94f1-86070e189d57 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:37:58.866469 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a33f1219-fc9d-4fb8-94f1-86070e189d57 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:58.867690 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a33f1219-fc9d-4fb8-94f1-86070e189d57 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:58.871356 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a33f1219-fc9d-4fb8-94f1-86070e189d57 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:58.872737 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a33f1219-fc9d-4fb8-94f1-86070e189d57 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:59.067279 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-a33f1219-fc9d-4fb8-94f1-86070e189d57 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:37:59.090733 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-a33f1219-fc9d-4fb8-94f1-86070e189d57 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1605 microversion: 2.1 time: 0.250352 Jun 21 18:37:59.092270 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 356/702] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:37:58 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1605 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:37:59.551473 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-ec2ae183-a6fe-4e78-a92e-8d9d517df9dd req-79ecdda4-39d1-4251-9256-4f6243dbed66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e", "name": "network-vif-deleted", "tag": "0c04c020-626c-4450-aa54-6781ab086cee"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:37:59.595815 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-ec2ae183-a6fe-4e78-a92e-8d9d517df9dd req-79ecdda4-39d1-4251-9256-4f6243dbed66 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:37:59.596582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-ec2ae183-a6fe-4e78-a92e-8d9d517df9dd req-79ecdda4-39d1-4251-9256-4f6243dbed66 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:37:59.649351 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-ec2ae183-a6fe-4e78-a92e-8d9d517df9dd req-79ecdda4-39d1-4251-9256-4f6243dbed66 service nova] Creating event network-vif-deleted:0c04c020-626c-4450-aa54-6781ab086cee for instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e on hv-cinder-84460 Jun 21 18:37:59.680262 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-ec2ae183-a6fe-4e78-a92e-8d9d517df9dd req-79ecdda4-39d1-4251-9256-4f6243dbed66 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144350 Jun 21 18:37:59.681129 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 347/703] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:38:00.123408 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f1d92d51-c19f-4868-ac41-a87fcf50fca7 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:00.127438 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f1d92d51-c19f-4868-ac41-a87fcf50fca7 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:00.145349 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f1d92d51-c19f-4868-ac41-a87fcf50fca7 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:00.147350 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f1d92d51-c19f-4868-ac41-a87fcf50fca7 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:00.148976 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f1d92d51-c19f-4868-ac41-a87fcf50fca7 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:00.150848 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f1d92d51-c19f-4868-ac41-a87fcf50fca7 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:00.242924 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f1d92d51-c19f-4868-ac41-a87fcf50fca7 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:00.244105 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f1d92d51-c19f-4868-ac41-a87fcf50fca7 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:00.245174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.objects.instance [None req-f1d92d51-c19f-4868-ac41-a87fcf50fca7 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lazy-loading 'fault' on Instance uuid f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e {{(pid=118109) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:38:00.415910 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f1d92d51-c19f-4868-ac41-a87fcf50fca7 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:00.484809 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f1d92d51-c19f-4868-ac41-a87fcf50fca7 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 200 len: 1327 microversion: 2.1 time: 0.371800 Jun 21 18:38:00.490676 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 357/704] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:00 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 1327 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:01.518129 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f8f36cea-3301-4b82-b3dd-e65a8efe8974 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:01.519434 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f8f36cea-3301-4b82-b3dd-e65a8efe8974 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:01.530672 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f8f36cea-3301-4b82-b3dd-e65a8efe8974 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:01.531615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f8f36cea-3301-4b82-b3dd-e65a8efe8974 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:01.533470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f8f36cea-3301-4b82-b3dd-e65a8efe8974 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:01.534151 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f8f36cea-3301-4b82-b3dd-e65a8efe8974 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:01.556904 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-f8f36cea-3301-4b82-b3dd-e65a8efe8974 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] HTTP exception thrown: Instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e could not be found. Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f8f36cea-3301-4b82-b3dd-e65a8efe8974 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Request method failure captured: Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e HTTP/1.1 Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABisg4b5iP8NqvQaqLZMQOX17D08o8A7fg9Ot-ige1NWhVqvFHnDB3G6E_m1QKnYBakDyNPFWwu87nrNNsP8iUhNHwlm0pC00yNjpiKUa5c2iDV--laqn2ubVFlmaxemMBDeDKwfXSe867iALKtJnevww3w_urmBkmsubhnfWkrOl-c4ZI Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 3c88935a83d24e408c99cb711ae46257 Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-AttachVolumeTestJSON-1959880149 Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:38:01.560170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:38:01.562947 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c88935a83d24e408c99cb711ae46257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c88935a83d24e408c99cb711ae46257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c88935a83d24e408c99cb711ae46257"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c88935a83d24e408c99cb711ae46257"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:38:01.562947 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-AttachVolumeTestJSON-1959880149 Jun 21 18:38:01.562947 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 3c88935a83d24e408c99cb711ae46257 Jun 21 18:38:01.562947 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1959880149 Jun 21 18:38:01.562947 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-AttachVolumeTestJSON-1959880149-project Jun 21 18:38:01.562947 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:38:01.562947 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:38:01.562947 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: acf9a33e9fb941939010989a89a51d38 Jun 21 18:38:01.562947 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-AttachVolumeTestJSON-1959880149-project Jun 21 18:38:01.562947 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:38:01.562947 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e could not be found. Jun 21 18:38:01.562947 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': 'f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e'} Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e could not be found. Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:38:01.564401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:38:01.567419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:38:01.567419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:38:01.567419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:38:01.567419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:38:01.567419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:38:01.567419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:38:01.567419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:38:01.567419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e could not be found. Jun 21 18:38:01.567419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:38:01.567419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:38:01.567419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:38:01.567419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:38:01.567419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:38:01.567419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:38:01.567419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:38:01.567419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:38:01.567419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e could not be found. Jun 21 18:38:01.567419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:38:01.569666 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f8f36cea-3301-4b82-b3dd-e65a8efe8974 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Returning 404 to user: Instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:38:01.569666 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f8f36cea-3301-4b82-b3dd-e65a8efe8974 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 404 len: 111 microversion: 2.1 time: 0.050654 Jun 21 18:38:01.569666 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 348/705] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:01 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:38:01.577397 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-fdfd476f-04c8-4a42-a343-4a353bed50ea tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '.version_select at 0x7fd8b8086280>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:01.615294 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-fdfd476f-04c8-4a42-a343-4a353bed50ea tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010660305" status: 202 len: 0 microversion: 2.1 time: 0.043784 Jun 21 18:38:01.616460 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 358/706] 10.222.0.87 () {58 vars in 1220 bytes} [Tue Jun 21 18:38:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010660305 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:38:02.720340 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-48d7e4eb-d1d3-412e-b46c-bd5656ddc2ce tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Action: 'create', calling method: .version_select at 0x7fd8b808b160>, body: {"keypair": {"name": "tempest-keypair-291766471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhD2P1vVLfC1X1XZf30/mJ5KyCCqIGkRts4sMDZJN6hJw5Kv1c6AeUncE4zKuC05i0AauuAO0xOLfw9f0cioPOK3lcOx21YPGUB8yeSz+syEt+9Qt74Y06nlxW7M+HUSQ=="}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:02.751284 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-48d7e4eb-d1d3-412e-b46c-bd5656ddc2ce tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Getting quotas for project 3c88935a83d24e408c99cb711ae46257. Resources: {'key_pairs'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:38:02.760453 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-48d7e4eb-d1d3-412e-b46c-bd5656ddc2ce tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Getting quotas for user acf9a33e9fb941939010989a89a51d38 and project 3c88935a83d24e408c99cb711ae46257. Resources: {'key_pairs'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:38:02.802646 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-48d7e4eb-d1d3-412e-b46c-bd5656ddc2ce tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.088463 Jun 21 18:38:02.803962 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 349/707] 10.222.0.87 () {60 vars in 1158 bytes} [Tue Jun 21 18:38:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:38:05.163291 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8584c3f3-7ee4-4549-8e24-6fd7046cd702 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-500313996", "imageRef": "c28659fb-c2d3-4dda-a330-1323a974987e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3045cac3-4145-4de7-8ebd-18844bcf0906"}], "security_groups": [{"name": "tempest-securitygroup--268008613"}], "key_name": "tempest-keypair-291766471", "user_data": "}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:05.185092 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:38:05.363547 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.network.neutron [None req-8584c3f3-7ee4-4549-8e24-6fd7046cd702 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] validate_networks() for [('3045cac3-4145-4de7-8ebd-18844bcf0906', None, None, None, None, None)] {{(pid=118109) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:38:06.051977 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-8584c3f3-7ee4-4549-8e24-6fd7046cd702 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Flavor limits 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:38:06.052540 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-8584c3f3-7ee4-4549-8e24-6fd7046cd702 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Image limits 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:38:06.053164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-8584c3f3-7ee4-4549-8e24-6fd7046cd702 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Flavor pref 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:38:06.053718 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-8584c3f3-7ee4-4549-8e24-6fd7046cd702 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Image pref 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:38:06.054326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-8584c3f3-7ee4-4549-8e24-6fd7046cd702 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:38:06.067517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8584c3f3-7ee4-4549-8e24-6fd7046cd702 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:06.068348 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8584c3f3-7ee4-4549-8e24-6fd7046cd702 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:06.069744 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8584c3f3-7ee4-4549-8e24-6fd7046cd702 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:06.070345 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8584c3f3-7ee4-4549-8e24-6fd7046cd702 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:06.097561 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-8584c3f3-7ee4-4549-8e24-6fd7046cd702 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Getting quotas for project 3c88935a83d24e408c99cb711ae46257. Resources: {'instances', 'ram', 'cores'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:38:06.103810 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-8584c3f3-7ee4-4549-8e24-6fd7046cd702 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Getting quotas for user acf9a33e9fb941939010989a89a51d38 and project 3c88935a83d24e408c99cb711ae46257. Resources: {'instances', 'ram', 'cores'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:38:06.125972 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8584c3f3-7ee4-4549-8e24-6fd7046cd702 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Going to run 1 instances... {{(pid=118109) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:38:06.130269 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8584c3f3-7ee4-4549-8e24-6fd7046cd702 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c28659fb-c2d3-4dda-a330-1323a974987e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118109) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:38:06.218629 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8584c3f3-7ee4-4549-8e24-6fd7046cd702 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.060149 Jun 21 18:38:06.220381 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 359/708] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:38:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:38:06.238258 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-11df2141-b4a9-4430-b445-6beec262680b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:06.239507 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-11df2141-b4a9-4430-b445-6beec262680b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:06.250070 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:38:06.386737 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-11df2141-b4a9-4430-b445-6beec262680b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:06.396559 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-11df2141-b4a9-4430-b445-6beec262680b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148" status: 200 len: 1236 microversion: 2.1 time: 0.168182 Jun 21 18:38:06.410604 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 350/709] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:06 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 => generated 1236 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:07.432393 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1e7151cc-3951-4019-b00f-af9f00fe60fd tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:07.435082 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1e7151cc-3951-4019-b00f-af9f00fe60fd tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:07.451229 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1e7151cc-3951-4019-b00f-af9f00fe60fd tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:07.452698 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1e7151cc-3951-4019-b00f-af9f00fe60fd tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:07.454996 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1e7151cc-3951-4019-b00f-af9f00fe60fd tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:07.456632 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1e7151cc-3951-4019-b00f-af9f00fe60fd tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:07.786838 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1e7151cc-3951-4019-b00f-af9f00fe60fd tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:07.810121 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1e7151cc-3951-4019-b00f-af9f00fe60fd tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148" status: 200 len: 1288 microversion: 2.1 time: 0.391690 Jun 21 18:38:07.813082 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 360/710] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:07 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 => generated 1288 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:08.835736 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-1cbb3d97-d759-4e1c-b8e1-70becda8593b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:08.849329 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-1cbb3d97-d759-4e1c-b8e1-70becda8593b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:08.863002 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1cbb3d97-d759-4e1c-b8e1-70becda8593b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:08.865251 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1cbb3d97-d759-4e1c-b8e1-70becda8593b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:08.867277 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1cbb3d97-d759-4e1c-b8e1-70becda8593b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:08.868826 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1cbb3d97-d759-4e1c-b8e1-70becda8593b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:08.999362 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-1cbb3d97-d759-4e1c-b8e1-70becda8593b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:09.023917 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-1cbb3d97-d759-4e1c-b8e1-70becda8593b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148" status: 200 len: 1294 microversion: 2.1 time: 0.195538 Jun 21 18:38:09.026265 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 351/711] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:08 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 => generated 1294 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:10.052533 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-5cf65590-414e-4703-abc3-44d29d344149 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:10.061781 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-5cf65590-414e-4703-abc3-44d29d344149 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:10.088622 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5cf65590-414e-4703-abc3-44d29d344149 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:10.089881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5cf65590-414e-4703-abc3-44d29d344149 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:10.091873 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5cf65590-414e-4703-abc3-44d29d344149 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:10.093326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5cf65590-414e-4703-abc3-44d29d344149 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:10.531187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-5cf65590-414e-4703-abc3-44d29d344149 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:10.543886 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-63d3eb20-be31-4904-80fc-f31d6177d248 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Action: 'create', calling method: .version_select at 0x7fd8b2f64790>, body: {"keypair": {"name": "tempest-keypair-1746252391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1Qsp7TEhBFB+JX39MonwbZXlM6XhnBhQjGVCubjU/Z+zs9AAgXesyOPvZcnj3eYBGc/We2o1343nLgi1OXkrC6o/B3MdCaW13WdPB+qTrXNS6MukGd3V0ycGI/eISymQ=="}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:10.545878 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-5cf65590-414e-4703-abc3-44d29d344149 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148" status: 200 len: 1361 microversion: 2.1 time: 0.502711 Jun 21 18:38:10.548129 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 361/712] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:10 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 => generated 1361 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:10.573483 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-63d3eb20-be31-4904-80fc-f31d6177d248 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Getting quotas for project 21a4c114c12d40abb896e2637ee6ab83. Resources: {'key_pairs'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:38:10.581406 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-63d3eb20-be31-4904-80fc-f31d6177d248 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Getting quotas for user 93785710c10749f9aa3d29b43965909c and project 21a4c114c12d40abb896e2637ee6ab83. Resources: {'key_pairs'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:38:10.637185 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-63d3eb20-be31-4904-80fc-f31d6177d248 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.420694 Jun 21 18:38:10.638262 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 352/713] 10.222.0.87 () {62 vars in 1199 bytes} [Tue Jun 21 18:38:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 423 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 21 18:38:10.824791 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-7f23a9a1-6b0f-4179-a578-499c13ce1368 req-4e5bcae0-53f5-4c03-82b2-c78757c99d05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c42fc280-3e6d-4ac0-8b86-d7d69dc8f148", "tag": "da5e8ac4-f318-4263-b7b5-fc58bd1bdf39"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:10.876071 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-7f23a9a1-6b0f-4179-a578-499c13ce1368 req-4e5bcae0-53f5-4c03-82b2-c78757c99d05 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:10.877499 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-7f23a9a1-6b0f-4179-a578-499c13ce1368 req-4e5bcae0-53f5-4c03-82b2-c78757c99d05 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:10.913607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-7f23a9a1-6b0f-4179-a578-499c13ce1368 req-4e5bcae0-53f5-4c03-82b2-c78757c99d05 service nova] Creating event network-changed:da5e8ac4-f318-4263-b7b5-fc58bd1bdf39 for instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 on hv-cinder-84460 Jun 21 18:38:10.934900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-7f23a9a1-6b0f-4179-a578-499c13ce1368 req-4e5bcae0-53f5-4c03-82b2-c78757c99d05 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134815 Jun 21 18:38:10.936433 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 362/714] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:38:11.588251 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f18117b3-5599-4e10-9047-e9bd1f67aaa3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:11.589140 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f18117b3-5599-4e10-9047-e9bd1f67aaa3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:11.635379 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f18117b3-5599-4e10-9047-e9bd1f67aaa3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:11.636068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f18117b3-5599-4e10-9047-e9bd1f67aaa3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:11.637154 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f18117b3-5599-4e10-9047-e9bd1f67aaa3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:11.638694 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f18117b3-5599-4e10-9047-e9bd1f67aaa3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:11.933848 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f18117b3-5599-4e10-9047-e9bd1f67aaa3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:11.953265 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f18117b3-5599-4e10-9047-e9bd1f67aaa3 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148" status: 200 len: 1361 microversion: 2.1 time: 0.379133 Jun 21 18:38:11.954743 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 353/715] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:11 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 => generated 1361 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:12.987821 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-35f14515-ee5f-4108-9e0b-de72f79d81b2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:12.990798 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-35f14515-ee5f-4108-9e0b-de72f79d81b2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:13.009252 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-35f14515-ee5f-4108-9e0b-de72f79d81b2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:13.012169 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-35f14515-ee5f-4108-9e0b-de72f79d81b2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:13.014182 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-35f14515-ee5f-4108-9e0b-de72f79d81b2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:13.015207 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-35f14515-ee5f-4108-9e0b-de72f79d81b2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:13.369805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e317d030-a66c-418a-be0c-f405b3056471 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-680795924", "imageRef": "c28659fb-c2d3-4dda-a330-1323a974987e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "154818ed-45dc-4361-88eb-8c702043f742"}], "security_groups": [{"name": "tempest-securitygroup--1094752131"}], "key_name": "tempest-keypair-1746252391", "user_data": "}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:13.377439 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-35f14515-ee5f-4108-9e0b-de72f79d81b2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:13.399231 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-35f14515-ee5f-4108-9e0b-de72f79d81b2 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148" status: 200 len: 1361 microversion: 2.1 time: 0.420887 Jun 21 18:38:13.406271 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 363/716] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:12 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 => generated 1361 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:13.562202 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.network.neutron [None req-e317d030-a66c-418a-be0c-f405b3056471 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] validate_networks() for [('154818ed-45dc-4361-88eb-8c702043f742', None, None, None, None, None)] {{(pid=118108) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:38:14.308386 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-e317d030-a66c-418a-be0c-f405b3056471 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Flavor limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:38:14.308842 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-e317d030-a66c-418a-be0c-f405b3056471 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Image limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:38:14.309841 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-e317d030-a66c-418a-be0c-f405b3056471 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Flavor pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:38:14.310335 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-e317d030-a66c-418a-be0c-f405b3056471 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Image pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:38:14.310910 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-e317d030-a66c-418a-be0c-f405b3056471 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:38:14.326489 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e317d030-a66c-418a-be0c-f405b3056471 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:14.327671 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e317d030-a66c-418a-be0c-f405b3056471 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:14.329319 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e317d030-a66c-418a-be0c-f405b3056471 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:14.330554 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e317d030-a66c-418a-be0c-f405b3056471 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:14.366768 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-e317d030-a66c-418a-be0c-f405b3056471 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Getting quotas for project 21a4c114c12d40abb896e2637ee6ab83. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:38:14.376836 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-e317d030-a66c-418a-be0c-f405b3056471 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Getting quotas for user 93785710c10749f9aa3d29b43965909c and project 21a4c114c12d40abb896e2637ee6ab83. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:38:14.402959 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e317d030-a66c-418a-be0c-f405b3056471 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Going to run 1 instances... {{(pid=118108) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:38:14.407537 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e317d030-a66c-418a-be0c-f405b3056471 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c28659fb-c2d3-4dda-a330-1323a974987e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118108) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:38:14.435259 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-00dc6e22-75ca-478d-aa9b-3a85f17c687a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:14.437232 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-00dc6e22-75ca-478d-aa9b-3a85f17c687a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:14.450764 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-00dc6e22-75ca-478d-aa9b-3a85f17c687a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:14.452049 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-00dc6e22-75ca-478d-aa9b-3a85f17c687a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:14.454322 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-00dc6e22-75ca-478d-aa9b-3a85f17c687a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:14.455522 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-00dc6e22-75ca-478d-aa9b-3a85f17c687a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:14.554293 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e317d030-a66c-418a-be0c-f405b3056471 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.190704 Jun 21 18:38:14.555684 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 354/717] 10.222.0.87 () {62 vars in 1187 bytes} [Tue Jun 21 18:38:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 21 18:38:14.582373 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-794ece0b-98d2-4e80-a73f-65966e352d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:14.584083 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-794ece0b-98d2-4e80-a73f-65966e352d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:14.754330 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-794ece0b-98d2-4e80-a73f-65966e352d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:14.788791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-794ece0b-98d2-4e80-a73f-65966e352d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:14.792668 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-794ece0b-98d2-4e80-a73f-65966e352d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:14.795934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-794ece0b-98d2-4e80-a73f-65966e352d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1281 microversion: 2.20 time: 0.222296 Jun 21 18:38:14.798171 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 355/718] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:38:14 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1281 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:38:14.805142 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-00dc6e22-75ca-478d-aa9b-3a85f17c687a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:14.822962 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-00dc6e22-75ca-478d-aa9b-3a85f17c687a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148" status: 200 len: 1361 microversion: 2.1 time: 0.397551 Jun 21 18:38:14.837676 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 364/719] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:14 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 => generated 1361 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:15.819722 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2b20932a-d598-4c37-9748-093a6c2fed0c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:15.820453 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-2b20932a-d598-4c37-9748-093a6c2fed0c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:15.841519 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2b20932a-d598-4c37-9748-093a6c2fed0c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:15.842648 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2b20932a-d598-4c37-9748-093a6c2fed0c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:15.849191 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2b20932a-d598-4c37-9748-093a6c2fed0c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:15.849885 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2b20932a-d598-4c37-9748-093a6c2fed0c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:15.855515 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-543e744d-d92d-4031-b197-e0982ee35904 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:15.856629 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-543e744d-d92d-4031-b197-e0982ee35904 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:15.890520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-543e744d-d92d-4031-b197-e0982ee35904 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:15.890868 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-543e744d-d92d-4031-b197-e0982ee35904 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:15.892325 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-543e744d-d92d-4031-b197-e0982ee35904 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:15.893339 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-543e744d-d92d-4031-b197-e0982ee35904 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:15.969528 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2b20932a-d598-4c37-9748-093a6c2fed0c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:15.988625 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2b20932a-d598-4c37-9748-093a6c2fed0c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:15.992898 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2b20932a-d598-4c37-9748-093a6c2fed0c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:15.994539 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2b20932a-d598-4c37-9748-093a6c2fed0c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1333 microversion: 2.20 time: 0.179105 Jun 21 18:38:15.995371 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 356/720] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:38:15 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1333 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:38:16.083396 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=2 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:38:16.116382 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=6 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:38:16.168073 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-543e744d-d92d-4031-b197-e0982ee35904 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:16.187418 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-543e744d-d92d-4031-b197-e0982ee35904 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148" status: 200 len: 1361 microversion: 2.1 time: 0.339409 Jun 21 18:38:16.189145 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 365/721] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:15 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 => generated 1361 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:17.025347 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c3e6ad18-9a91-4c9c-9e72-588f3644a52d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:17.026417 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c3e6ad18-9a91-4c9c-9e72-588f3644a52d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:17.038471 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c3e6ad18-9a91-4c9c-9e72-588f3644a52d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:17.039337 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c3e6ad18-9a91-4c9c-9e72-588f3644a52d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:17.042050 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c3e6ad18-9a91-4c9c-9e72-588f3644a52d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:17.042822 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c3e6ad18-9a91-4c9c-9e72-588f3644a52d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:17.135699 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-369839f1-92c5-48bb-a25a-9cddbafd21b3 req-765b2f3d-bd57-431b-9bb7-d8789c26cac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42fc280-3e6d-4ac0-8b86-d7d69dc8f148", "name": "network-vif-plugged", "status": "completed", "tag": "da5e8ac4-f318-4263-b7b5-fc58bd1bdf39"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:17.158144 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-369839f1-92c5-48bb-a25a-9cddbafd21b3 req-765b2f3d-bd57-431b-9bb7-d8789c26cac6 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:17.159200 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-369839f1-92c5-48bb-a25a-9cddbafd21b3 req-765b2f3d-bd57-431b-9bb7-d8789c26cac6 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:17.172621 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c3e6ad18-9a91-4c9c-9e72-588f3644a52d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:17.181176 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-369839f1-92c5-48bb-a25a-9cddbafd21b3 req-765b2f3d-bd57-431b-9bb7-d8789c26cac6 service nova] Creating event network-vif-plugged:da5e8ac4-f318-4263-b7b5-fc58bd1bdf39 for instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 on hv-cinder-84460 Jun 21 18:38:17.187854 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-369839f1-92c5-48bb-a25a-9cddbafd21b3 req-765b2f3d-bd57-431b-9bb7-d8789c26cac6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056329 Jun 21 18:38:17.188911 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 366/722] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:38:17.191240 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c3e6ad18-9a91-4c9c-9e72-588f3644a52d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:17.195730 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c3e6ad18-9a91-4c9c-9e72-588f3644a52d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:17.199223 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c3e6ad18-9a91-4c9c-9e72-588f3644a52d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1339 microversion: 2.20 time: 0.180545 Jun 21 18:38:17.217941 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6a24bb2b-d568-4e85-a1c7-8e6906e172e0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:17.219032 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6a24bb2b-d568-4e85-a1c7-8e6906e172e0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:17.221873 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 357/723] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:38:17 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1339 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:38:17.226486 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6a24bb2b-d568-4e85-a1c7-8e6906e172e0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:17.227349 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6a24bb2b-d568-4e85-a1c7-8e6906e172e0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:17.228355 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6a24bb2b-d568-4e85-a1c7-8e6906e172e0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:17.228975 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6a24bb2b-d568-4e85-a1c7-8e6906e172e0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:17.431970 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-6a24bb2b-d568-4e85-a1c7-8e6906e172e0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:17.443510 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6a24bb2b-d568-4e85-a1c7-8e6906e172e0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148" status: 200 len: 1361 microversion: 2.1 time: 0.230180 Jun 21 18:38:17.446754 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 367/724] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:17 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:38:18.233649 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f0aab5a1-518a-4401-98e2-ff761ddba78c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:18.234876 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f0aab5a1-518a-4401-98e2-ff761ddba78c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:18.246808 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f0aab5a1-518a-4401-98e2-ff761ddba78c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:18.247260 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f0aab5a1-518a-4401-98e2-ff761ddba78c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:18.248187 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f0aab5a1-518a-4401-98e2-ff761ddba78c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:18.248754 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f0aab5a1-518a-4401-98e2-ff761ddba78c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:18.252207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:38:18.467537 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b1f37108-4609-43dc-aca7-85abdce15c77 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:18.468943 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b1f37108-4609-43dc-aca7-85abdce15c77 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:18.469364 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f0aab5a1-518a-4401-98e2-ff761ddba78c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:18.481040 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b1f37108-4609-43dc-aca7-85abdce15c77 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:18.481892 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b1f37108-4609-43dc-aca7-85abdce15c77 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:18.483604 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b1f37108-4609-43dc-aca7-85abdce15c77 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:18.484602 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b1f37108-4609-43dc-aca7-85abdce15c77 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:18.486347 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f0aab5a1-518a-4401-98e2-ff761ddba78c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:18.489735 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f0aab5a1-518a-4401-98e2-ff761ddba78c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:18.492157 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f0aab5a1-518a-4401-98e2-ff761ddba78c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1407 microversion: 2.20 time: 0.265984 Jun 21 18:38:18.494349 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 358/725] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:38:18 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:38:18.719386 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b1f37108-4609-43dc-aca7-85abdce15c77 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:18.732587 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b1f37108-4609-43dc-aca7-85abdce15c77 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148" status: 200 len: 1361 microversion: 2.1 time: 0.273409 Jun 21 18:38:18.733433 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 368/726] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:18 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 => generated 1361 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:38:19.370722 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-0920591e-bdb0-4788-a927-302f95798d7a req-98ce1e1f-c1dc-464e-897f-ec3d889277fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aab1542-b7fd-4057-9da2-8bcef1265883", "tag": "c320e6d5-945e-46d1-b2a9-bf683bd75477"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:19.387541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-0920591e-bdb0-4788-a927-302f95798d7a req-98ce1e1f-c1dc-464e-897f-ec3d889277fa service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:19.388724 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-0920591e-bdb0-4788-a927-302f95798d7a req-98ce1e1f-c1dc-464e-897f-ec3d889277fa service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:19.409295 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-0920591e-bdb0-4788-a927-302f95798d7a req-98ce1e1f-c1dc-464e-897f-ec3d889277fa service nova] Creating event network-changed:c320e6d5-945e-46d1-b2a9-bf683bd75477 for instance 4aab1542-b7fd-4057-9da2-8bcef1265883 on hv-cinder-84460 Jun 21 18:38:19.416277 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-0920591e-bdb0-4788-a927-302f95798d7a req-98ce1e1f-c1dc-464e-897f-ec3d889277fa service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052567 Jun 21 18:38:19.416993 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 359/727] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:38:19.517399 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8ce15dc2-39cd-4752-adde-c439679e056d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:19.519844 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8ce15dc2-39cd-4752-adde-c439679e056d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:19.531593 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8ce15dc2-39cd-4752-adde-c439679e056d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:19.532450 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8ce15dc2-39cd-4752-adde-c439679e056d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:19.533833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8ce15dc2-39cd-4752-adde-c439679e056d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:19.534638 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8ce15dc2-39cd-4752-adde-c439679e056d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:19.734869 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-8ce15dc2-39cd-4752-adde-c439679e056d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:19.746393 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-8ce15dc2-39cd-4752-adde-c439679e056d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:19.754633 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-8ce15dc2-39cd-4752-adde-c439679e056d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:19.756907 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-bffaa719-6e0c-4d5d-ab09-9593249bd842 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:19.758963 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-bffaa719-6e0c-4d5d-ab09-9593249bd842 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:19.759487 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8ce15dc2-39cd-4752-adde-c439679e056d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1407 microversion: 2.20 time: 0.248819 Jun 21 18:38:19.761277 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 369/728] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:38:19 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:38:19.770975 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bffaa719-6e0c-4d5d-ab09-9593249bd842 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:19.772146 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bffaa719-6e0c-4d5d-ab09-9593249bd842 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:19.773670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bffaa719-6e0c-4d5d-ab09-9593249bd842 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:19.774471 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bffaa719-6e0c-4d5d-ab09-9593249bd842 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:19.966046 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-bffaa719-6e0c-4d5d-ab09-9593249bd842 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:19.976124 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-bffaa719-6e0c-4d5d-ab09-9593249bd842 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148" status: 200 len: 1546 microversion: 2.1 time: 0.226474 Jun 21 18:38:19.976884 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 360/729] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:19 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 => generated 1546 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:19.994742 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2fa0099d-9898-4712-847d-7dba3475a902 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:19.995314 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-2fa0099d-9898-4712-847d-7dba3475a902 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:20.004916 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2fa0099d-9898-4712-847d-7dba3475a902 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:20.005773 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2fa0099d-9898-4712-847d-7dba3475a902 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:20.007245 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2fa0099d-9898-4712-847d-7dba3475a902 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:20.008057 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2fa0099d-9898-4712-847d-7dba3475a902 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:20.107472 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-2fa0099d-9898-4712-847d-7dba3475a902 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116672 Jun 21 18:38:20.108624 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 370/730] 10.222.0.87 () {58 vars in 1274 bytes} [Tue Jun 21 18:38:19 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:38:20.786525 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-99352306-5daf-4fd8-8f0a-cfe8d266ca60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:20.787126 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-99352306-5daf-4fd8-8f0a-cfe8d266ca60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:20.797433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-99352306-5daf-4fd8-8f0a-cfe8d266ca60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:20.798140 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-99352306-5daf-4fd8-8f0a-cfe8d266ca60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:20.799217 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-99352306-5daf-4fd8-8f0a-cfe8d266ca60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:20.799872 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-99352306-5daf-4fd8-8f0a-cfe8d266ca60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:21.194318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-99352306-5daf-4fd8-8f0a-cfe8d266ca60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:21.210384 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-99352306-5daf-4fd8-8f0a-cfe8d266ca60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:21.213614 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-99352306-5daf-4fd8-8f0a-cfe8d266ca60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:21.215915 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-99352306-5daf-4fd8-8f0a-cfe8d266ca60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1407 microversion: 2.20 time: 0.435020 Jun 21 18:38:21.219098 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 361/731] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:38:20 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1407 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:38:22.044733 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-8aab7b4a-7145-49dc-bf78-796cbc2a6b62 req-a9756df2-62b6-408d-9e36-b130e753a890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c42fc280-3e6d-4ac0-8b86-d7d69dc8f148", "tag": "da5e8ac4-f318-4263-b7b5-fc58bd1bdf39"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:22.060047 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-8aab7b4a-7145-49dc-bf78-796cbc2a6b62 req-a9756df2-62b6-408d-9e36-b130e753a890 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:22.060518 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-8aab7b4a-7145-49dc-bf78-796cbc2a6b62 req-a9756df2-62b6-408d-9e36-b130e753a890 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:22.078862 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-8aab7b4a-7145-49dc-bf78-796cbc2a6b62 req-a9756df2-62b6-408d-9e36-b130e753a890 service nova] Creating event network-changed:da5e8ac4-f318-4263-b7b5-fc58bd1bdf39 for instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 on hv-cinder-84460 Jun 21 18:38:22.086092 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-8aab7b4a-7145-49dc-bf78-796cbc2a6b62 req-a9756df2-62b6-408d-9e36-b130e753a890 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050021 Jun 21 18:38:22.087198 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 371/732] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:38:22.239091 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-55f08222-3142-487c-9e9d-7bbf789e6ee6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:22.240066 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-55f08222-3142-487c-9e9d-7bbf789e6ee6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:22.248750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-55f08222-3142-487c-9e9d-7bbf789e6ee6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:22.249357 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-55f08222-3142-487c-9e9d-7bbf789e6ee6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:22.250437 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-55f08222-3142-487c-9e9d-7bbf789e6ee6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:22.251040 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-55f08222-3142-487c-9e9d-7bbf789e6ee6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:22.484868 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-55f08222-3142-487c-9e9d-7bbf789e6ee6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:22.495392 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-55f08222-3142-487c-9e9d-7bbf789e6ee6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:22.497296 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-55f08222-3142-487c-9e9d-7bbf789e6ee6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:22.498610 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-55f08222-3142-487c-9e9d-7bbf789e6ee6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1407 microversion: 2.20 time: 0.264571 Jun 21 18:38:22.499260 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 362/733] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:38:22 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:38:23.525278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-353374e1-73f0-4f94-a412-9924a53d128a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:23.532605 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-353374e1-73f0-4f94-a412-9924a53d128a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:23.551579 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-353374e1-73f0-4f94-a412-9924a53d128a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:23.552681 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-353374e1-73f0-4f94-a412-9924a53d128a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:23.554587 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-353374e1-73f0-4f94-a412-9924a53d128a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:23.555796 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-353374e1-73f0-4f94-a412-9924a53d128a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:23.564919 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:38:23.818614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-353374e1-73f0-4f94-a412-9924a53d128a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:23.836451 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-353374e1-73f0-4f94-a412-9924a53d128a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:23.845287 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-353374e1-73f0-4f94-a412-9924a53d128a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:23.845287 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-353374e1-73f0-4f94-a412-9924a53d128a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1407 microversion: 2.20 time: 0.325764 Jun 21 18:38:23.850303 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 372/734] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:38:23 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:38:24.865210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-63e1f471-d7d9-4c2c-8013-d139c1892293 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:24.865875 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-63e1f471-d7d9-4c2c-8013-d139c1892293 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:24.868360 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=2 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:38:24.869191 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=18 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:38:24.878366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-63e1f471-d7d9-4c2c-8013-d139c1892293 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:24.878957 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-63e1f471-d7d9-4c2c-8013-d139c1892293 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:24.879840 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-63e1f471-d7d9-4c2c-8013-d139c1892293 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:24.880576 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-63e1f471-d7d9-4c2c-8013-d139c1892293 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:25.050601 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-63e1f471-d7d9-4c2c-8013-d139c1892293 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:25.061323 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-63e1f471-d7d9-4c2c-8013-d139c1892293 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:25.063276 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-63e1f471-d7d9-4c2c-8013-d139c1892293 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:25.064760 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-63e1f471-d7d9-4c2c-8013-d139c1892293 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1407 microversion: 2.20 time: 0.203899 Jun 21 18:38:25.065513 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 363/735] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:38:24 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:38:25.283472 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-34bc8b5b-b35f-4d1f-91d2-6a58136e716d req-111dc4d4-c7bc-4904-b212-47a5ce89e305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aab1542-b7fd-4057-9da2-8bcef1265883", "name": "network-vif-plugged", "status": "completed", "tag": "c320e6d5-945e-46d1-b2a9-bf683bd75477"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:25.298245 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-34bc8b5b-b35f-4d1f-91d2-6a58136e716d req-111dc4d4-c7bc-4904-b212-47a5ce89e305 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:25.298804 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-34bc8b5b-b35f-4d1f-91d2-6a58136e716d req-111dc4d4-c7bc-4904-b212-47a5ce89e305 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:25.320008 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-34bc8b5b-b35f-4d1f-91d2-6a58136e716d req-111dc4d4-c7bc-4904-b212-47a5ce89e305 service nova] Creating event network-vif-plugged:c320e6d5-945e-46d1-b2a9-bf683bd75477 for instance 4aab1542-b7fd-4057-9da2-8bcef1265883 on hv-cinder-84460 Jun 21 18:38:25.328060 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-34bc8b5b-b35f-4d1f-91d2-6a58136e716d req-111dc4d4-c7bc-4904-b212-47a5ce89e305 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050992 Jun 21 18:38:25.329017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 373/736] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:38:26.087396 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-ace77ea4-d6ed-44ce-ac9a-86531897ab17 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:26.088058 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-ace77ea4-d6ed-44ce-ac9a-86531897ab17 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:26.096200 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ace77ea4-d6ed-44ce-ac9a-86531897ab17 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:26.096646 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ace77ea4-d6ed-44ce-ac9a-86531897ab17 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:26.097443 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ace77ea4-d6ed-44ce-ac9a-86531897ab17 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:26.097914 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ace77ea4-d6ed-44ce-ac9a-86531897ab17 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:26.264442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ace77ea4-d6ed-44ce-ac9a-86531897ab17 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:26.274525 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ace77ea4-d6ed-44ce-ac9a-86531897ab17 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:26.276286 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ace77ea4-d6ed-44ce-ac9a-86531897ab17 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:26.278169 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-ace77ea4-d6ed-44ce-ac9a-86531897ab17 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1407 microversion: 2.20 time: 0.195220 Jun 21 18:38:26.278909 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 364/737] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:38:26 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:38:27.299592 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c6f2c78b-0398-425a-ba0a-bd05aae7bb87 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:27.300308 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c6f2c78b-0398-425a-ba0a-bd05aae7bb87 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:27.308966 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c6f2c78b-0398-425a-ba0a-bd05aae7bb87 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:27.309747 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c6f2c78b-0398-425a-ba0a-bd05aae7bb87 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:27.310930 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c6f2c78b-0398-425a-ba0a-bd05aae7bb87 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:27.311499 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c6f2c78b-0398-425a-ba0a-bd05aae7bb87 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:27.472783 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c6f2c78b-0398-425a-ba0a-bd05aae7bb87 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:27.486167 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c6f2c78b-0398-425a-ba0a-bd05aae7bb87 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:27.488657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c6f2c78b-0398-425a-ba0a-bd05aae7bb87 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:27.490309 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c6f2c78b-0398-425a-ba0a-bd05aae7bb87 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1407 microversion: 2.20 time: 0.196519 Jun 21 18:38:27.491358 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 374/738] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:38:27 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:38:28.511421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-04fca2eb-f953-45c3-9cff-30ed184d45ba tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:28.512195 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-04fca2eb-f953-45c3-9cff-30ed184d45ba tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:28.522260 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-04fca2eb-f953-45c3-9cff-30ed184d45ba tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:28.523543 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-04fca2eb-f953-45c3-9cff-30ed184d45ba tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:28.524861 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-04fca2eb-f953-45c3-9cff-30ed184d45ba tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:28.525957 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-04fca2eb-f953-45c3-9cff-30ed184d45ba tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:28.707585 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-04fca2eb-f953-45c3-9cff-30ed184d45ba tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:28.719833 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-04fca2eb-f953-45c3-9cff-30ed184d45ba tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:28.721777 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-04fca2eb-f953-45c3-9cff-30ed184d45ba tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:28.723199 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-04fca2eb-f953-45c3-9cff-30ed184d45ba tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1599 microversion: 2.20 time: 0.217421 Jun 21 18:38:28.723842 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 365/739] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:38:28 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:38:28.742434 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ee55209a-03e9-4687-8e76-cfc7d8d382e5 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:28.743060 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ee55209a-03e9-4687-8e76-cfc7d8d382e5 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:28.750980 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ee55209a-03e9-4687-8e76-cfc7d8d382e5 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:28.751441 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ee55209a-03e9-4687-8e76-cfc7d8d382e5 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:28.752239 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ee55209a-03e9-4687-8e76-cfc7d8d382e5 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:28.752682 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ee55209a-03e9-4687-8e76-cfc7d8d382e5 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:28.875997 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ee55209a-03e9-4687-8e76-cfc7d8d382e5 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.137487 Jun 21 18:38:28.877081 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 375/740] 10.222.0.87 () {60 vars in 1315 bytes} [Tue Jun 21 18:38:28 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:38:30.177124 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-e23fcb45-f4af-4a88-aa8c-34871bb6094e req-bc03540d-25fd-45b8-a9a0-61351690a8be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aab1542-b7fd-4057-9da2-8bcef1265883", "tag": "c320e6d5-945e-46d1-b2a9-bf683bd75477"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:30.186898 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-e23fcb45-f4af-4a88-aa8c-34871bb6094e req-bc03540d-25fd-45b8-a9a0-61351690a8be service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:30.187332 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-e23fcb45-f4af-4a88-aa8c-34871bb6094e req-bc03540d-25fd-45b8-a9a0-61351690a8be service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:30.200618 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-e23fcb45-f4af-4a88-aa8c-34871bb6094e req-bc03540d-25fd-45b8-a9a0-61351690a8be service nova] Creating event network-changed:c320e6d5-945e-46d1-b2a9-bf683bd75477 for instance 4aab1542-b7fd-4057-9da2-8bcef1265883 on hv-cinder-84460 Jun 21 18:38:30.206416 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-e23fcb45-f4af-4a88-aa8c-34871bb6094e req-bc03540d-25fd-45b8-a9a0-61351690a8be service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032923 Jun 21 18:38:30.207553 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 366/741] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:38:39.448100 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:38:39.449236 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=17 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:38:39.454982 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ea484dd1-6ede-4fc1-ad06-07164c4e2621 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:39.455539 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ea484dd1-6ede-4fc1-ad06-07164c4e2621 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:39.464978 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ea484dd1-6ede-4fc1-ad06-07164c4e2621 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:39.465430 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ea484dd1-6ede-4fc1-ad06-07164c4e2621 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:39.466361 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ea484dd1-6ede-4fc1-ad06-07164c4e2621 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:39.466806 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ea484dd1-6ede-4fc1-ad06-07164c4e2621 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:39.494753 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ea484dd1-6ede-4fc1-ad06-07164c4e2621 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823/ips" status: 200 len: 149 microversion: 2.1 time: 0.048411 Jun 21 18:38:39.495417 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 376/742] 10.222.0.87 () {58 vars in 1247 bytes} [Tue Jun 21 18:38:39 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:38:40.912822 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:38:40.914162 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=45 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:38:40.919823 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-0109837e-d2c4-4a1e-bbb6-a699bb244d06 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6330c9d-b1cc-4d22-8bbb-194cfd362ce0"}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:40.921027 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-0109837e-d2c4-4a1e-bbb6-a699bb244d06 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:40.929682 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0109837e-d2c4-4a1e-bbb6-a699bb244d06 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:40.930268 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0109837e-d2c4-4a1e-bbb6-a699bb244d06 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:40.931070 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0109837e-d2c4-4a1e-bbb6-a699bb244d06 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:40.931523 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0109837e-d2c4-4a1e-bbb6-a699bb244d06 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:41.254918 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-0109837e-d2c4-4a1e-bbb6-a699bb244d06 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "POST /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343552 Jun 21 18:38:41.255796 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 367/743] 10.222.0.87 () {60 vars in 1322 bytes} [Tue Jun 21 18:38:40 2022] POST /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:38:48.860167 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-0aef5d90-96a9-4586-9c46-ab389f04db84 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6330c9d-b1cc-4d22-8bbb-194cfd362ce0"}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:48.861917 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-0aef5d90-96a9-4586-9c46-ab389f04db84 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:48.869770 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0aef5d90-96a9-4586-9c46-ab389f04db84 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:48.870059 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0aef5d90-96a9-4586-9c46-ab389f04db84 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:48.870842 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0aef5d90-96a9-4586-9c46-ab389f04db84 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:48.871276 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0aef5d90-96a9-4586-9c46-ab389f04db84 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:48.973969 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-0aef5d90-96a9-4586-9c46-ab389f04db84 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] HTTP exception thrown: Invalid volume: volume d6330c9d-b1cc-4d22-8bbb-194cfd362ce0 is already attached to instances: 095e34aa-ee35-4453-b440-559af6d24823 Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-0aef5d90-96a9-4586-9c46-ab389f04db84 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Request method failure captured: Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: POST /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823/os-volume_attachments HTTP/1.1 Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 74 Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg4ZMAWXxe61N6ctbFJeKvVgvvqMTa2oRmY5e2O5Oda6LMfZg9xpstvKI3ZJkXmTItstccH4E1PbiQoDoOZ0pGDVym3uwQfnL3hWTQsURjldIWUJ8D1X_g1vsEm62qgxRWdgSwijxdtKtfaabBZ19cJ69ajwcodYMs6ciOaGSF1872Y Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:38:48.976938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:38:48.978806 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:38:48.978806 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:38:48.978806 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:38:48.978806 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:38:48.978806 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:38:48.978806 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:38:48.978806 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:38:48.978806 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: 144c9c31ed9b469aa200dcb16c89ab4e Jun 21 18:38:48.978806 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:38:48.978806 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Jun 21 18:38:48.978806 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {"volumeAttachment": {"volumeId": "d6330c9d-b1cc-4d22-8bbb-194cfd362ce0"}} Jun 21 18:38:48.978806 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:38:48.979784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Invalid volume: volume d6330c9d-b1cc-4d22-8bbb-194cfd362ce0 is already attached to instances: 095e34aa-ee35-4453-b440-559af6d24823 Jun 21 18:38:48.979784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'server_id': '095e34aa-ee35-4453-b440-559af6d24823', 'body': {'volumeAttachment': {'volumeId': 'd6330c9d-b1cc-4d22-8bbb-194cfd362ce0'}}} Jun 21 18:38:48.979784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:38:48.979784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:38:48.979784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 18:38:48.979784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 18:38:48.979784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 18:38:48.979784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 18:38:48.979784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 18:38:48.979784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 18:38:48.979784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 18:38:48.979784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 18:38:48.979784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 18:38:48.979784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 18:38:48.979784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d6330c9d-b1cc-4d22-8bbb-194cfd362ce0 is already attached to instances: 095e34aa-ee35-4453-b440-559af6d24823 Jun 21 18:38:48.979784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:38:48.979784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:38:48.979784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:38:48.979784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d6330c9d-b1cc-4d22-8bbb-194cfd362ce0 is already attached to instances: 095e34aa-ee35-4453-b440-559af6d24823 Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:38:48.982017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:38:48.983985 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:38:48.983985 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:38:48.983985 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:38:48.983985 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d6330c9d-b1cc-4d22-8bbb-194cfd362ce0 is already attached to instances: 095e34aa-ee35-4453-b440-559af6d24823 Jun 21 18:38:48.983985 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:38:48.983985 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-0aef5d90-96a9-4586-9c46-ab389f04db84 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Returning 400 to user: Invalid volume: volume d6330c9d-b1cc-4d22-8bbb-194cfd362ce0 is already attached to instances: 095e34aa-ee35-4453-b440-559af6d24823 {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:38:48.983985 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-0aef5d90-96a9-4586-9c46-ab389f04db84 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "POST /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123409 Jun 21 18:38:48.983985 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 377/744] 10.222.0.87 () {60 vars in 1322 bytes} [Tue Jun 21 18:38:48 2022] POST /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823/os-volume_attachments => generated 174 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 18:38:49.073936 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-77ca3455-5acb-4caf-996e-6c8497b88d21 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:49.074868 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-77ca3455-5acb-4caf-996e-6c8497b88d21 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:49.091233 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-77ca3455-5acb-4caf-996e-6c8497b88d21 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:49.091841 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-77ca3455-5acb-4caf-996e-6c8497b88d21 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:49.092821 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-77ca3455-5acb-4caf-996e-6c8497b88d21 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:49.093312 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-77ca3455-5acb-4caf-996e-6c8497b88d21 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:49.213958 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.objects.instance [None req-77ca3455-5acb-4caf-996e-6c8497b88d21 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lazy-loading 'services' on Instance uuid 095e34aa-ee35-4453-b440-559af6d24823 {{(pid=118108) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:38:49.309865 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-77ca3455-5acb-4caf-996e-6c8497b88d21 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "DELETE /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823/os-volume_attachments/d6330c9d-b1cc-4d22-8bbb-194cfd362ce0" status: 202 len: 0 microversion: 2.1 time: 0.240586 Jun 21 18:38:49.310621 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 368/745] 10.222.0.87 () {58 vars in 1415 bytes} [Tue Jun 21 18:38:49 2022] DELETE /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823/os-volume_attachments/d6330c9d-b1cc-4d22-8bbb-194cfd362ce0 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:38:49.324229 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e793e6e4-15c3-4e8c-8469-cab7ec390cc8 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:49.326323 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e793e6e4-15c3-4e8c-8469-cab7ec390cc8 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:49.338569 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e793e6e4-15c3-4e8c-8469-cab7ec390cc8 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:49.339415 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e793e6e4-15c3-4e8c-8469-cab7ec390cc8 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:49.340868 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e793e6e4-15c3-4e8c-8469-cab7ec390cc8 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:49.342354 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e793e6e4-15c3-4e8c-8469-cab7ec390cc8 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:49.386440 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e793e6e4-15c3-4e8c-8469-cab7ec390cc8 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069922 Jun 21 18:38:49.387086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 378/746] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:38:49 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:38:50.404187 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e43fcd8b-8eb9-481a-a287-30a211e32fbe tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:50.405926 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e43fcd8b-8eb9-481a-a287-30a211e32fbe tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:50.417889 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e43fcd8b-8eb9-481a-a287-30a211e32fbe tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:50.418541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e43fcd8b-8eb9-481a-a287-30a211e32fbe tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:50.419766 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e43fcd8b-8eb9-481a-a287-30a211e32fbe tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:50.420412 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e43fcd8b-8eb9-481a-a287-30a211e32fbe tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:50.471826 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e43fcd8b-8eb9-481a-a287-30a211e32fbe tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076100 Jun 21 18:38:50.472416 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 369/747] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:38:50 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 18:38:50.549478 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-89405bb5-3cee-41cc-a977-efdc71812107 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:50.550219 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-89405bb5-3cee-41cc-a977-efdc71812107 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:50.558413 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-89405bb5-3cee-41cc-a977-efdc71812107 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:50.558413 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-89405bb5-3cee-41cc-a977-efdc71812107 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:50.559086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-89405bb5-3cee-41cc-a977-efdc71812107 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:50.559518 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-89405bb5-3cee-41cc-a977-efdc71812107 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:50.589549 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-89405bb5-3cee-41cc-a977-efdc71812107 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Going to try to terminate instance {{(pid=118109) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:38:50.704282 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-89405bb5-3cee-41cc-a977-efdc71812107 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "DELETE /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 204 len: 0 microversion: 2.1 time: 0.158090 Jun 21 18:38:50.705507 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 379/748] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:38:50 2022] DELETE /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 18:38:50.718945 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-207f9e39-d6e4-47c1-9364-27f6eb94c17a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:50.720025 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-207f9e39-d6e4-47c1-9364-27f6eb94c17a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:50.728200 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-207f9e39-d6e4-47c1-9364-27f6eb94c17a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:50.728815 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-207f9e39-d6e4-47c1-9364-27f6eb94c17a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:50.729841 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-207f9e39-d6e4-47c1-9364-27f6eb94c17a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:50.730334 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-207f9e39-d6e4-47c1-9364-27f6eb94c17a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:50.889129 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-207f9e39-d6e4-47c1-9364-27f6eb94c17a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:50.902695 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-207f9e39-d6e4-47c1-9364-27f6eb94c17a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 200 len: 1681 microversion: 2.1 time: 0.189031 Jun 21 18:38:50.903689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 370/749] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:50 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:51.409836 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-332129c8-d808-453d-8896-ca5967af164a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-383546993"}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:51.410709 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-332129c8-d808-453d-8896-ca5967af164a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:51.418095 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-332129c8-d808-453d-8896-ca5967af164a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:51.418687 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-332129c8-d808-453d-8896-ca5967af164a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:51.419593 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-332129c8-d808-453d-8896-ca5967af164a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:51.420270 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-332129c8-d808-453d-8896-ca5967af164a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:51.579612 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.network.security_group_api [None req-332129c8-d808-453d-8896-ca5967af164a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Removing security group d969a2fa-04de-46db-8950-690e9c17baa9 from port 1726067c-21f2-4c33-a050-983a29ae5f04 Jun 21 18:38:51.923215 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-ce6c1553-d8b1-4e83-9eaa-c691bcea836e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:51.924675 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-ce6c1553-d8b1-4e83-9eaa-c691bcea836e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:51.932927 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ce6c1553-d8b1-4e83-9eaa-c691bcea836e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:51.933375 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ce6c1553-d8b1-4e83-9eaa-c691bcea836e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:51.934411 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ce6c1553-d8b1-4e83-9eaa-c691bcea836e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:51.935164 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ce6c1553-d8b1-4e83-9eaa-c691bcea836e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:52.160684 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-332129c8-d808-453d-8896-ca5967af164a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "POST /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580/action" status: 202 len: 0 microversion: 2.1 time: 0.755408 Jun 21 18:38:52.161323 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 380/750] 10.222.0.87 () {60 vars in 1277 bytes} [Tue Jun 21 18:38:51 2022] POST /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580/action => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:38:52.176456 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-43824c3b-2659-48b7-8285-f16a1c5dace4 req-5265cc49-3dea-4ecd-acc6-147c55b801b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35920613-c14d-4e14-8d6d-bb7b8aad3580", "tag": "1726067c-21f2-4c33-a050-983a29ae5f04"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:52.186218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-43824c3b-2659-48b7-8285-f16a1c5dace4 req-5265cc49-3dea-4ecd-acc6-147c55b801b9 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:52.187037 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-43824c3b-2659-48b7-8285-f16a1c5dace4 req-5265cc49-3dea-4ecd-acc6-147c55b801b9 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:52.200428 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-43824c3b-2659-48b7-8285-f16a1c5dace4 req-5265cc49-3dea-4ecd-acc6-147c55b801b9 service nova] Creating event network-changed:1726067c-21f2-4c33-a050-983a29ae5f04 for instance 35920613-c14d-4e14-8d6d-bb7b8aad3580 on hv-cinder-84460 Jun 21 18:38:52.206529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-43824c3b-2659-48b7-8285-f16a1c5dace4 req-5265cc49-3dea-4ecd-acc6-147c55b801b9 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033628 Jun 21 18:38:52.207829 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 381/751] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:38:52.250475 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ce6c1553-d8b1-4e83-9eaa-c691bcea836e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:52.273155 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-ce6c1553-d8b1-4e83-9eaa-c691bcea836e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 200 len: 1681 microversion: 2.1 time: 0.354213 Jun 21 18:38:52.295942 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 371/752] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:51 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 1681 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:53.314421 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-73c2f131-2e78-453b-af5b-4bb770966c82 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:53.316473 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-73c2f131-2e78-453b-af5b-4bb770966c82 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:53.330429 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-73c2f131-2e78-453b-af5b-4bb770966c82 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:53.331207 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-73c2f131-2e78-453b-af5b-4bb770966c82 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:53.332391 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-73c2f131-2e78-453b-af5b-4bb770966c82 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:53.333407 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-73c2f131-2e78-453b-af5b-4bb770966c82 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:53.742943 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-73c2f131-2e78-453b-af5b-4bb770966c82 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:53.753842 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-73c2f131-2e78-453b-af5b-4bb770966c82 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 200 len: 1681 microversion: 2.1 time: 0.448732 Jun 21 18:38:53.754438 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 382/753] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:53 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 1681 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:54.775763 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-af0a856a-96d7-43c0-b919-562463248283 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:54.776842 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-af0a856a-96d7-43c0-b919-562463248283 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:54.787078 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-af0a856a-96d7-43c0-b919-562463248283 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:54.787815 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-af0a856a-96d7-43c0-b919-562463248283 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:54.788677 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-af0a856a-96d7-43c0-b919-562463248283 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:54.789119 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-af0a856a-96d7-43c0-b919-562463248283 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:54.903867 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-af0a856a-96d7-43c0-b919-562463248283 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:54.924723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-af0a856a-96d7-43c0-b919-562463248283 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 200 len: 1613 microversion: 2.1 time: 0.153445 Jun 21 18:38:54.929429 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 372/754] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:54 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 1613 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:38:55.044474 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-1411e759-56d3-4be4-99ee-302e6ce04551 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:55.049704 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-b3a54358-30b8-4e2d-b1a3-d47d8140e9cc req-4e99b4ff-adb9-4777-840a-bcc51a6fd328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "095e34aa-ee35-4453-b440-559af6d24823", "name": "network-vif-deleted", "tag": "b5836f02-f91c-4847-a499-ae60785f7508"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:55.051809 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-1411e759-56d3-4be4-99ee-302e6ce04551 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:55.074724 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1411e759-56d3-4be4-99ee-302e6ce04551 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:55.076193 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1411e759-56d3-4be4-99ee-302e6ce04551 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:55.077407 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1411e759-56d3-4be4-99ee-302e6ce04551 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:55.079908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-b3a54358-30b8-4e2d-b1a3-d47d8140e9cc req-4e99b4ff-adb9-4777-840a-bcc51a6fd328 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:55.080517 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1411e759-56d3-4be4-99ee-302e6ce04551 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:55.085931 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-b3a54358-30b8-4e2d-b1a3-d47d8140e9cc req-4e99b4ff-adb9-4777-840a-bcc51a6fd328 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:55.120640 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-b3a54358-30b8-4e2d-b1a3-d47d8140e9cc req-4e99b4ff-adb9-4777-840a-bcc51a6fd328 service nova] Creating event network-vif-deleted:b5836f02-f91c-4847-a499-ae60785f7508 for instance 095e34aa-ee35-4453-b440-559af6d24823 on hv-cinder-84460 Jun 21 18:38:55.137451 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-b3a54358-30b8-4e2d-b1a3-d47d8140e9cc req-4e99b4ff-adb9-4777-840a-bcc51a6fd328 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099926 Jun 21 18:38:55.138957 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 383/755] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:38:55.324856 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.objects.instance [None req-1411e759-56d3-4be4-99ee-302e6ce04551 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lazy-loading 'services' on Instance uuid 35920613-c14d-4e14-8d6d-bb7b8aad3580 {{(pid=118108) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:38:55.433143 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-1411e759-56d3-4be4-99ee-302e6ce04551 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "DELETE /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580/os-volume_attachments/f12968c8-48ad-4230-a8ce-0993fa125e3c" status: 202 len: 0 microversion: 2.1 time: 0.392598 Jun 21 18:38:55.434294 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 373/756] 10.222.0.87 () {58 vars in 1415 bytes} [Tue Jun 21 18:38:55 2022] DELETE /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580/os-volume_attachments/f12968c8-48ad-4230-a8ce-0993fa125e3c => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:38:55.445179 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-db66f3c9-825e-4be2-8987-c0ba91459f3a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:55.446468 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-db66f3c9-825e-4be2-8987-c0ba91459f3a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:55.458759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-db66f3c9-825e-4be2-8987-c0ba91459f3a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:55.460189 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-db66f3c9-825e-4be2-8987-c0ba91459f3a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:55.461854 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-db66f3c9-825e-4be2-8987-c0ba91459f3a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:55.462957 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-db66f3c9-825e-4be2-8987-c0ba91459f3a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:55.517138 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-db66f3c9-825e-4be2-8987-c0ba91459f3a tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077245 Jun 21 18:38:55.518655 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 384/757] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:38:55 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:38:55.957692 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-47346c81-3bd1-4e13-9202-fc3878683463 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:55.959387 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-47346c81-3bd1-4e13-9202-fc3878683463 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:55.968242 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-47346c81-3bd1-4e13-9202-fc3878683463 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:55.969238 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-47346c81-3bd1-4e13-9202-fc3878683463 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:55.970268 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-47346c81-3bd1-4e13-9202-fc3878683463 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:55.971274 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-47346c81-3bd1-4e13-9202-fc3878683463 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:55.996402 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-47346c81-3bd1-4e13-9202-fc3878683463 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] HTTP exception thrown: Instance 095e34aa-ee35-4453-b440-559af6d24823 could not be found. Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-47346c81-3bd1-4e13-9202-fc3878683463 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Request method failure captured: Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 HTTP/1.1 Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABisg4ZMAWXxe61N6ctbFJeKvVgvvqMTa2oRmY5e2O5Oda6LMfZg9xpstvKI3ZJkXmTItstccH4E1PbiQoDoOZ0pGDVym3uwQfnL3hWTQsURjldIWUJ8D1X_g1vsEm62qgxRWdgSwijxdtKtfaabBZ19cJ69ajwcodYMs6ciOaGSF1872Y Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:38:55.998444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:38:56.000925 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:38:56.000925 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:38:56.000925 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:38:56.000925 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:38:56.000925 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:38:56.000925 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:38:56.000925 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:38:56.000925 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 144c9c31ed9b469aa200dcb16c89ab4e Jun 21 18:38:56.000925 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:38:56.000925 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:38:56.000925 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance 095e34aa-ee35-4453-b440-559af6d24823 could not be found. Jun 21 18:38:56.000925 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': '095e34aa-ee35-4453-b440-559af6d24823'} Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 095e34aa-ee35-4453-b440-559af6d24823 could not be found. Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:38:56.003128 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:38:56.008795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:38:56.008795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:38:56.008795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:38:56.008795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:38:56.008795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:38:56.008795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:38:56.008795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:38:56.008795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 095e34aa-ee35-4453-b440-559af6d24823 could not be found. Jun 21 18:38:56.008795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:38:56.008795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:38:56.008795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:38:56.008795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:38:56.008795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:38:56.008795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:38:56.008795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:38:56.008795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:38:56.008795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 095e34aa-ee35-4453-b440-559af6d24823 could not be found. Jun 21 18:38:56.008795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:38:56.013982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-47346c81-3bd1-4e13-9202-fc3878683463 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Returning 404 to user: Instance 095e34aa-ee35-4453-b440-559af6d24823 could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:38:56.013982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-47346c81-3bd1-4e13-9202-fc3878683463 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 404 len: 111 microversion: 2.1 time: 0.051395 Jun 21 18:38:56.013982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 374/758] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:55 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:38:56.014675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-fb1890e7-1768-4d84-aee0-e491c70bcf52 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '.version_select at 0x7fd8b2e959d0>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:56.035302 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-fb1890e7-1768-4d84-aee0-e491c70bcf52 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274331111" status: 202 len: 0 microversion: 2.1 time: 0.026634 Jun 21 18:38:56.037738 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 385/759] 10.222.0.87 () {58 vars in 1220 bytes} [Tue Jun 21 18:38:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274331111 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:38:56.540933 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-eacaf907-92a7-449f-9952-29e72d37e3c8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:56.542590 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-eacaf907-92a7-449f-9952-29e72d37e3c8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:56.561409 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eacaf907-92a7-449f-9952-29e72d37e3c8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:56.562624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eacaf907-92a7-449f-9952-29e72d37e3c8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:56.564716 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eacaf907-92a7-449f-9952-29e72d37e3c8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:56.566241 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eacaf907-92a7-449f-9952-29e72d37e3c8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:56.692116 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-eacaf907-92a7-449f-9952-29e72d37e3c8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163481 Jun 21 18:38:56.699184 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 375/760] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:38:56 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:38:57.158813 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-12bf94d7-6ea2-4833-8e8e-0a1537d283bb req-ac0a9054-bb77-4b98-8067-e2856a679f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35920613-c14d-4e14-8d6d-bb7b8aad3580", "tag": "1726067c-21f2-4c33-a050-983a29ae5f04"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:57.162106 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a53af6b3-ff45-437e-a4e8-f32698aa951a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Action: 'create', calling method: .version_select at 0x7fd8b2e9d550>, body: {"keypair": {"name": "tempest-keypair-936788233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsl0DAZhPTKA9JRw7B6ZV3OOX2p8nQLoYU4iJh1LsFQyzq2FRAt3E0zmnD2H6UV1kKc1tHUtNplLf8zk/rYMbPtA3Pyx98JWTO+ZJLvJL7eaMGXqB/bYG/v2PxeOR/esw=="}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:57.172050 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-12bf94d7-6ea2-4833-8e8e-0a1537d283bb req-ac0a9054-bb77-4b98-8067-e2856a679f66 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:57.172494 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-12bf94d7-6ea2-4833-8e8e-0a1537d283bb req-ac0a9054-bb77-4b98-8067-e2856a679f66 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:57.185489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-12bf94d7-6ea2-4833-8e8e-0a1537d283bb req-ac0a9054-bb77-4b98-8067-e2856a679f66 service nova] Creating event network-changed:1726067c-21f2-4c33-a050-983a29ae5f04 for instance 35920613-c14d-4e14-8d6d-bb7b8aad3580 on hv-cinder-84460 Jun 21 18:38:57.189212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-a53af6b3-ff45-437e-a4e8-f32698aa951a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Getting quotas for project 53e2bb9f793041c2aef6e222b76c3961. Resources: {'key_pairs'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:38:57.190812 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-12bf94d7-6ea2-4833-8e8e-0a1537d283bb req-ac0a9054-bb77-4b98-8067-e2856a679f66 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036363 Jun 21 18:38:57.191717 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 386/761] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:38:57.196904 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-a53af6b3-ff45-437e-a4e8-f32698aa951a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Getting quotas for user 144c9c31ed9b469aa200dcb16c89ab4e and project 53e2bb9f793041c2aef6e222b76c3961. Resources: {'key_pairs'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:38:57.234764 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a53af6b3-ff45-437e-a4e8-f32698aa951a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.079596 Jun 21 18:38:57.235878 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 376/762] 10.222.0.87 () {60 vars in 1158 bytes} [Tue Jun 21 18:38:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:38:57.709327 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bde0a780-f11c-4a33-a118-52d8051391d8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:57.710991 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-bde0a780-f11c-4a33-a118-52d8051391d8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:57.722949 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bde0a780-f11c-4a33-a118-52d8051391d8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:57.723767 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bde0a780-f11c-4a33-a118-52d8051391d8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:57.726452 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bde0a780-f11c-4a33-a118-52d8051391d8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:57.727258 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bde0a780-f11c-4a33-a118-52d8051391d8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:57.784608 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-bde0a780-f11c-4a33-a118-52d8051391d8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080870 Jun 21 18:38:57.785630 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 387/763] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:38:57 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 18:38:57.802579 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a731f83a-c8bd-456b-ab3a-4a326084cc3f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:57.803782 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-a731f83a-c8bd-456b-ab3a-4a326084cc3f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:57.816753 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a731f83a-c8bd-456b-ab3a-4a326084cc3f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:57.817531 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a731f83a-c8bd-456b-ab3a-4a326084cc3f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:57.818616 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a731f83a-c8bd-456b-ab3a-4a326084cc3f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:57.820129 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a731f83a-c8bd-456b-ab3a-4a326084cc3f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:57.959324 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-a731f83a-c8bd-456b-ab3a-4a326084cc3f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] HTTP exception thrown: Instance 35920613-c14d-4e14-8d6d-bb7b8aad3580 is not attached to volume f12968c8-48ad-4230-a8ce-0993fa125e3c Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a731f83a-c8bd-456b-ab3a-4a326084cc3f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Request method failure captured: Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: DELETE /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580/os-volume_attachments/f12968c8-48ad-4230-a8ce-0993fa125e3c HTTP/1.1 Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABisg9iSCR0n_YAPbl0calKBzC_NahPFd-eZqGx3nmYj59wYxj1no-pWX2bd_XvxeR4ji_5fSJzN3YAqE5Kfa5tee80wPBAOkYs3GfFJsTDvdLRkxXFDXVP2PeM4eYasi9yVxxIy5vOdqlUzC-9VaNPJWypCzAV0HQYfPGItwWbPqCOHqE Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: b466c8d09c724e26a0883bd5315593c9 Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-TestMinimumBasicScenario-1765191423 Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:38:57.962955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:38:57.966043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b466c8d09c724e26a0883bd5315593c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b466c8d09c724e26a0883bd5315593c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b466c8d09c724e26a0883bd5315593c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b466c8d09c724e26a0883bd5315593c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:38:57.966043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-TestMinimumBasicScenario-1765191423 Jun 21 18:38:57.966043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: b466c8d09c724e26a0883bd5315593c9 Jun 21 18:38:57.966043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1765191423 Jun 21 18:38:57.966043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-TestMinimumBasicScenario-1765191423-project Jun 21 18:38:57.966043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:38:57.966043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:38:57.966043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 7220499985644eb3804911f12c018b88 Jun 21 18:38:57.966043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-TestMinimumBasicScenario-1765191423-project Jun 21 18:38:57.966043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:38:57.966043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance 35920613-c14d-4e14-8d6d-bb7b8aad3580 is not attached to volume f12968c8-48ad-4230-a8ce-0993fa125e3c Jun 21 18:38:57.967805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'server_id': '35920613-c14d-4e14-8d6d-bb7b8aad3580', 'id': 'f12968c8-48ad-4230-a8ce-0993fa125e3c'} Jun 21 18:38:57.967805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:38:57.967805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:38:57.967805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 21 18:38:57.967805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 21 18:38:57.967805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 18:38:57.967805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 18:38:57.967805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 21 18:38:57.967805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 21 18:38:57.967805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f12968c8-48ad-4230-a8ce-0993fa125e3c. Jun 21 18:38:57.967805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:38:57.967805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:38:57.967805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:38:57.967805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:38:57.967805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:38:57.967805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:38:57.967805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:38:57.967805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:38:57.967805 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:38:57.970338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:38:57.970338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 21 18:38:57.970338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 21 18:38:57.970338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35920613-c14d-4e14-8d6d-bb7b8aad3580 is not attached to volume f12968c8-48ad-4230-a8ce-0993fa125e3c Jun 21 18:38:57.970338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:38:57.970338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:38:57.970338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:38:57.970338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:38:57.970338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:38:57.970338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:38:57.970338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:38:57.970338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:38:57.970338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35920613-c14d-4e14-8d6d-bb7b8aad3580 is not attached to volume f12968c8-48ad-4230-a8ce-0993fa125e3c Jun 21 18:38:57.970338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:38:57.970338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a731f83a-c8bd-456b-ab3a-4a326084cc3f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Returning 404 to user: Instance 35920613-c14d-4e14-8d6d-bb7b8aad3580 is not attached to volume f12968c8-48ad-4230-a8ce-0993fa125e3c {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:38:57.972189 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a731f83a-c8bd-456b-ab3a-4a326084cc3f tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "DELETE /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580/os-volume_attachments/f12968c8-48ad-4230-a8ce-0993fa125e3c" status: 404 len: 154 microversion: 2.1 time: 0.171632 Jun 21 18:38:57.977704 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 377/764] 10.222.0.87 () {58 vars in 1415 bytes} [Tue Jun 21 18:38:57 2022] DELETE /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580/os-volume_attachments/f12968c8-48ad-4230-a8ce-0993fa125e3c => generated 154 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:38:59.179954 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1218fbb6-7d61-4851-9eca-a3f42eee42b1 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:59.180817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1218fbb6-7d61-4851-9eca-a3f42eee42b1 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:59.192052 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1218fbb6-7d61-4851-9eca-a3f42eee42b1 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:59.192822 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1218fbb6-7d61-4851-9eca-a3f42eee42b1 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:59.195147 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1218fbb6-7d61-4851-9eca-a3f42eee42b1 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:59.195746 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1218fbb6-7d61-4851-9eca-a3f42eee42b1 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:59.234844 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1218fbb6-7d61-4851-9eca-a3f42eee42b1 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Going to try to terminate instance {{(pid=118109) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:38:59.323932 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-59e7853c-e647-487c-8838-87c46a1917b9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1976109722", "imageRef": "c28659fb-c2d3-4dda-a330-1323a974987e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "29d4e26f-e314-4e70-8390-44e86b316d90"}], "security_groups": [{"name": "tempest-securitygroup--2029716550"}], "key_name": "tempest-keypair-936788233", "user_data": "}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:38:59.355594 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1218fbb6-7d61-4851-9eca-a3f42eee42b1 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "DELETE /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 204 len: 0 microversion: 2.1 time: 0.181985 Jun 21 18:38:59.356914 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 388/765] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:38:59 2022] DELETE /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:38:59.366281 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-df82a272-84a4-4702-910d-831e0ddcee56 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:38:59.367011 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-df82a272-84a4-4702-910d-831e0ddcee56 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:38:59.373938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-df82a272-84a4-4702-910d-831e0ddcee56 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:59.374525 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-df82a272-84a4-4702-910d-831e0ddcee56 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:59.375655 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-df82a272-84a4-4702-910d-831e0ddcee56 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:38:59.376098 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-df82a272-84a4-4702-910d-831e0ddcee56 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:38:59.543884 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.network.neutron [None req-59e7853c-e647-487c-8838-87c46a1917b9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] validate_networks() for [('29d4e26f-e314-4e70-8390-44e86b316d90', None, None, None, None, None)] {{(pid=118108) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:38:59.594793 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-df82a272-84a4-4702-910d-831e0ddcee56 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:38:59.604050 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-df82a272-84a4-4702-910d-831e0ddcee56 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1553 microversion: 2.1 time: 0.242059 Jun 21 18:38:59.604788 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 389/766] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:38:59 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1553 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:38:59.994268 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-59e7853c-e647-487c-8838-87c46a1917b9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Flavor limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:38:59.994268 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-59e7853c-e647-487c-8838-87c46a1917b9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Image limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:38:59.994993 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-59e7853c-e647-487c-8838-87c46a1917b9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Flavor pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:38:59.995403 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-59e7853c-e647-487c-8838-87c46a1917b9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Image pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:38:59.995800 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-59e7853c-e647-487c-8838-87c46a1917b9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:39:00.006052 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-59e7853c-e647-487c-8838-87c46a1917b9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:00.006561 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-59e7853c-e647-487c-8838-87c46a1917b9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:00.007361 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-59e7853c-e647-487c-8838-87c46a1917b9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:00.007793 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-59e7853c-e647-487c-8838-87c46a1917b9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:00.027925 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-59e7853c-e647-487c-8838-87c46a1917b9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Getting quotas for project 53e2bb9f793041c2aef6e222b76c3961. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:39:00.032942 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-59e7853c-e647-487c-8838-87c46a1917b9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Getting quotas for user 144c9c31ed9b469aa200dcb16c89ab4e and project 53e2bb9f793041c2aef6e222b76c3961. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:39:00.046757 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-59e7853c-e647-487c-8838-87c46a1917b9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Going to run 1 instances... {{(pid=118108) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:39:00.049121 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-59e7853c-e647-487c-8838-87c46a1917b9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c28659fb-c2d3-4dda-a330-1323a974987e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118108) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:39:00.114694 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-59e7853c-e647-487c-8838-87c46a1917b9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.800251 Jun 21 18:39:00.115764 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 378/767] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:38:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 18:39:00.129625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bc6910b4-6db2-499d-94b0-9855d8c0131d tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:00.130955 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-bc6910b4-6db2-499d-94b0-9855d8c0131d tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:00.216814 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-bc6910b4-6db2-499d-94b0-9855d8c0131d tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:39:00.226803 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-bc6910b4-6db2-499d-94b0-9855d8c0131d tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1241 microversion: 2.1 time: 0.104246 Jun 21 18:39:00.227522 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 390/768] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:00 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:39:00.628498 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5ed7e64c-617f-4a0e-a759-312c113dab4d tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:00.629497 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-5ed7e64c-617f-4a0e-a759-312c113dab4d tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:00.639847 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5ed7e64c-617f-4a0e-a759-312c113dab4d tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:00.640391 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5ed7e64c-617f-4a0e-a759-312c113dab4d tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:00.641269 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5ed7e64c-617f-4a0e-a759-312c113dab4d tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:00.641868 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5ed7e64c-617f-4a0e-a759-312c113dab4d tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:00.843016 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-5ed7e64c-617f-4a0e-a759-312c113dab4d tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:39:00.855051 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-5ed7e64c-617f-4a0e-a759-312c113dab4d tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1553 microversion: 2.1 time: 0.234849 Jun 21 18:39:00.855375 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 379/769] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:00 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1553 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:39:01.247599 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-0f5ebe50-e27c-4e87-b16b-bc418e811e6e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:01.248275 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-0f5ebe50-e27c-4e87-b16b-bc418e811e6e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:01.255325 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0f5ebe50-e27c-4e87-b16b-bc418e811e6e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:01.255851 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0f5ebe50-e27c-4e87-b16b-bc418e811e6e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:01.256705 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0f5ebe50-e27c-4e87-b16b-bc418e811e6e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:01.257152 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0f5ebe50-e27c-4e87-b16b-bc418e811e6e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:01.328294 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-0f5ebe50-e27c-4e87-b16b-bc418e811e6e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:39:01.337336 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-0f5ebe50-e27c-4e87-b16b-bc418e811e6e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1293 microversion: 2.1 time: 0.093818 Jun 21 18:39:01.338070 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 391/770] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:01 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:39:01.877922 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-0839bef3-4528-49b4-b7b5-263c828ab651 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:01.880131 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-0839bef3-4528-49b4-b7b5-263c828ab651 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:01.891770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0839bef3-4528-49b4-b7b5-263c828ab651 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:01.892471 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0839bef3-4528-49b4-b7b5-263c828ab651 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:01.893471 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0839bef3-4528-49b4-b7b5-263c828ab651 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:01.894190 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0839bef3-4528-49b4-b7b5-263c828ab651 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:02.211743 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-0839bef3-4528-49b4-b7b5-263c828ab651 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:39:02.220284 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-0839bef3-4528-49b4-b7b5-263c828ab651 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1553 microversion: 2.1 time: 0.350843 Jun 21 18:39:02.220862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 380/771] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:01 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1553 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:39:02.362137 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e0150e6f-8e06-48e7-8e7c-4081eb8b4414 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:02.363613 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e0150e6f-8e06-48e7-8e7c-4081eb8b4414 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:02.375755 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e0150e6f-8e06-48e7-8e7c-4081eb8b4414 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:02.377673 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e0150e6f-8e06-48e7-8e7c-4081eb8b4414 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:02.379376 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e0150e6f-8e06-48e7-8e7c-4081eb8b4414 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:02.380219 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e0150e6f-8e06-48e7-8e7c-4081eb8b4414 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:02.562551 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e0150e6f-8e06-48e7-8e7c-4081eb8b4414 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:39:02.585151 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-18341ad0-7e1a-4abe-8bf2-d353e87aea0b req-ac76c5f9-73f9-46a5-84ed-1b1c5edb9360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35920613-c14d-4e14-8d6d-bb7b8aad3580", "name": "network-vif-deleted", "tag": "1726067c-21f2-4c33-a050-983a29ae5f04"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:39:02.595191 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e0150e6f-8e06-48e7-8e7c-4081eb8b4414 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1299 microversion: 2.1 time: 0.237853 Jun 21 18:39:02.598210 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 392/772] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:02 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1299 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:39:02.599981 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-18341ad0-7e1a-4abe-8bf2-d353e87aea0b req-ac76c5f9-73f9-46a5-84ed-1b1c5edb9360 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:02.600940 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-18341ad0-7e1a-4abe-8bf2-d353e87aea0b req-ac76c5f9-73f9-46a5-84ed-1b1c5edb9360 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:02.637014 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-18341ad0-7e1a-4abe-8bf2-d353e87aea0b req-ac76c5f9-73f9-46a5-84ed-1b1c5edb9360 service nova] Creating event network-vif-deleted:1726067c-21f2-4c33-a050-983a29ae5f04 for instance 35920613-c14d-4e14-8d6d-bb7b8aad3580 on hv-cinder-84460 Jun 21 18:39:02.645604 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-18341ad0-7e1a-4abe-8bf2-d353e87aea0b req-ac76c5f9-73f9-46a5-84ed-1b1c5edb9360 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067403 Jun 21 18:39:02.646334 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 381/773] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:39:03.243801 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-d945fb51-9f03-4ec4-bf9d-83ba97d7008c tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:03.244709 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-d945fb51-9f03-4ec4-bf9d-83ba97d7008c tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:03.256272 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d945fb51-9f03-4ec4-bf9d-83ba97d7008c tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:03.257440 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d945fb51-9f03-4ec4-bf9d-83ba97d7008c tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:03.258386 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d945fb51-9f03-4ec4-bf9d-83ba97d7008c tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:03.259009 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d945fb51-9f03-4ec4-bf9d-83ba97d7008c tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:03.319012 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d945fb51-9f03-4ec4-bf9d-83ba97d7008c tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:03.319855 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d945fb51-9f03-4ec4-bf9d-83ba97d7008c tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:03.320562 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.objects.instance [None req-d945fb51-9f03-4ec4-bf9d-83ba97d7008c tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lazy-loading 'fault' on Instance uuid 35920613-c14d-4e14-8d6d-bb7b8aad3580 {{(pid=118109) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:39:03.324365 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:39:03.382504 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-d945fb51-9f03-4ec4-bf9d-83ba97d7008c tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7220499985644eb3804911f12c018b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b466c8d09c724e26a0883bd5315593c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:39:03.394306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-d945fb51-9f03-4ec4-bf9d-83ba97d7008c tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 200 len: 1347 microversion: 2.1 time: 0.154600 Jun 21 18:39:03.395924 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 393/774] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:03 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 1347 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:39:03.624608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-7f041f68-8d4a-4973-bb1a-e7018d4e633a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:03.625868 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-7f041f68-8d4a-4973-bb1a-e7018d4e633a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:03.636246 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7f041f68-8d4a-4973-bb1a-e7018d4e633a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:03.636787 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7f041f68-8d4a-4973-bb1a-e7018d4e633a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:03.637784 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7f041f68-8d4a-4973-bb1a-e7018d4e633a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:03.638328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7f041f68-8d4a-4973-bb1a-e7018d4e633a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:03.834924 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-7f041f68-8d4a-4973-bb1a-e7018d4e633a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:39:03.852897 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-7f041f68-8d4a-4973-bb1a-e7018d4e633a tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1367 microversion: 2.1 time: 0.233534 Jun 21 18:39:03.855047 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 382/775] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:03 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:39:04.053250 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-c412edc5-e0eb-4019-86dd-9321e7783e1d req-46296110-fd14-4270-8df3-a4f214bfbc3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "031fed05-1de1-49b6-8325-7a5ab4f19f1f", "tag": "561631ac-1f22-45ce-a83d-d5eb01c68fdb"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:39:04.066474 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-c412edc5-e0eb-4019-86dd-9321e7783e1d req-46296110-fd14-4270-8df3-a4f214bfbc3d service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:04.067172 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-c412edc5-e0eb-4019-86dd-9321e7783e1d req-46296110-fd14-4270-8df3-a4f214bfbc3d service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:04.111209 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-c412edc5-e0eb-4019-86dd-9321e7783e1d req-46296110-fd14-4270-8df3-a4f214bfbc3d service nova] Creating event network-changed:561631ac-1f22-45ce-a83d-d5eb01c68fdb for instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f on hv-cinder-84460 Jun 21 18:39:04.120916 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-c412edc5-e0eb-4019-86dd-9321e7783e1d req-46296110-fd14-4270-8df3-a4f214bfbc3d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071406 Jun 21 18:39:04.121599 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 394/776] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:39:04.425342 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-06846115-d780-4c84-bb5f-f3fa18fd1cc8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:04.426100 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-06846115-d780-4c84-bb5f-f3fa18fd1cc8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] [instance: 35920613-c14d-4e14-8d6d-bb7b8aad3580] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:04.432423 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-06846115-d780-4c84-bb5f-f3fa18fd1cc8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:04.432962 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-06846115-d780-4c84-bb5f-f3fa18fd1cc8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:04.433866 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-06846115-d780-4c84-bb5f-f3fa18fd1cc8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:04.434296 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-06846115-d780-4c84-bb5f-f3fa18fd1cc8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:04.450987 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-06846115-d780-4c84-bb5f-f3fa18fd1cc8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] HTTP exception thrown: Instance 35920613-c14d-4e14-8d6d-bb7b8aad3580 could not be found. Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-06846115-d780-4c84-bb5f-f3fa18fd1cc8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Request method failure captured: Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 HTTP/1.1 Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABisg9iSCR0n_YAPbl0calKBzC_NahPFd-eZqGx3nmYj59wYxj1no-pWX2bd_XvxeR4ji_5fSJzN3YAqE5Kfa5tee80wPBAOkYs3GfFJsTDvdLRkxXFDXVP2PeM4eYasi9yVxxIy5vOdqlUzC-9VaNPJWypCzAV0HQYfPGItwWbPqCOHqE Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: b466c8d09c724e26a0883bd5315593c9 Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-TestMinimumBasicScenario-1765191423 Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:39:04.452850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:39:04.455134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b466c8d09c724e26a0883bd5315593c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/b466c8d09c724e26a0883bd5315593c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/b466c8d09c724e26a0883bd5315593c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_b466c8d09c724e26a0883bd5315593c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:39:04.455134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-TestMinimumBasicScenario-1765191423 Jun 21 18:39:04.455134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: b466c8d09c724e26a0883bd5315593c9 Jun 21 18:39:04.455134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1765191423 Jun 21 18:39:04.455134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-TestMinimumBasicScenario-1765191423-project Jun 21 18:39:04.455134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:39:04.455134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:39:04.455134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 7220499985644eb3804911f12c018b88 Jun 21 18:39:04.455134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-TestMinimumBasicScenario-1765191423-project Jun 21 18:39:04.455134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:39:04.455134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance 35920613-c14d-4e14-8d6d-bb7b8aad3580 could not be found. Jun 21 18:39:04.455134 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': '35920613-c14d-4e14-8d6d-bb7b8aad3580'} Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35920613-c14d-4e14-8d6d-bb7b8aad3580 could not be found. Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:39:04.456389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:39:04.459725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:39:04.459725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:39:04.459725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:39:04.459725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:39:04.459725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:39:04.459725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:39:04.459725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:39:04.459725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35920613-c14d-4e14-8d6d-bb7b8aad3580 could not be found. Jun 21 18:39:04.459725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:39:04.459725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:39:04.459725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:39:04.459725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:39:04.459725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:39:04.459725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:39:04.459725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:39:04.459725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:39:04.459725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35920613-c14d-4e14-8d6d-bb7b8aad3580 could not be found. Jun 21 18:39:04.459725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:39:04.461798 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-06846115-d780-4c84-bb5f-f3fa18fd1cc8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Returning 404 to user: Instance 35920613-c14d-4e14-8d6d-bb7b8aad3580 could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:39:04.461798 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-06846115-d780-4c84-bb5f-f3fa18fd1cc8 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580" status: 404 len: 111 microversion: 2.1 time: 0.038228 Jun 21 18:39:04.461798 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 383/777] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:04 2022] GET /compute/v2.1/servers/35920613-c14d-4e14-8d6d-bb7b8aad3580 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:39:04.468007 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-aa07d5a1-83bd-42cf-a17c-6bfdc4d8f1f6 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] Calling method '.version_select at 0x7fd8b2ed8a60>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:04.491224 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-aa07d5a1-83bd-42cf-a17c-6bfdc4d8f1f6 tempest-TestMinimumBasicScenario-1765191423 tempest-TestMinimumBasicScenario-1765191423-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1290070238" status: 202 len: 0 microversion: 2.1 time: 0.027693 Jun 21 18:39:04.496194 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 395/778] 10.222.0.87 () {58 vars in 1271 bytes} [Tue Jun 21 18:39:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1290070238 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 18:39:04.879889 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b1542598-70aa-43bf-941b-e0c7eedfc103 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:04.881736 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b1542598-70aa-43bf-941b-e0c7eedfc103 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:04.894555 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b1542598-70aa-43bf-941b-e0c7eedfc103 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:04.895318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b1542598-70aa-43bf-941b-e0c7eedfc103 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:04.896751 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b1542598-70aa-43bf-941b-e0c7eedfc103 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:04.897851 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b1542598-70aa-43bf-941b-e0c7eedfc103 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:04.932213 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:39:05.103466 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-b1542598-70aa-43bf-941b-e0c7eedfc103 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:39:05.114700 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b1542598-70aa-43bf-941b-e0c7eedfc103 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1367 microversion: 2.1 time: 0.241992 Jun 21 18:39:05.115559 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 384/779] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:04 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:39:06.136316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-98a96f3e-b580-4a5b-8f95-eeaaac088ca8 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:06.137247 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-98a96f3e-b580-4a5b-8f95-eeaaac088ca8 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:06.147665 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-98a96f3e-b580-4a5b-8f95-eeaaac088ca8 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:06.148448 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-98a96f3e-b580-4a5b-8f95-eeaaac088ca8 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:06.149850 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-98a96f3e-b580-4a5b-8f95-eeaaac088ca8 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:06.150502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-98a96f3e-b580-4a5b-8f95-eeaaac088ca8 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:06.422421 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-98a96f3e-b580-4a5b-8f95-eeaaac088ca8 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:39:06.432108 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-98a96f3e-b580-4a5b-8f95-eeaaac088ca8 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1367 microversion: 2.1 time: 0.300749 Jun 21 18:39:06.432877 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 396/780] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:06 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:39:07.456301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4d59f711-9875-4139-b776-ddbd6f03b026 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:07.458940 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4d59f711-9875-4139-b776-ddbd6f03b026 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:07.471377 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4d59f711-9875-4139-b776-ddbd6f03b026 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:07.472264 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4d59f711-9875-4139-b776-ddbd6f03b026 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:07.474136 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4d59f711-9875-4139-b776-ddbd6f03b026 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:07.475274 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4d59f711-9875-4139-b776-ddbd6f03b026 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:07.809025 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-4d59f711-9875-4139-b776-ddbd6f03b026 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:39:07.821177 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4d59f711-9875-4139-b776-ddbd6f03b026 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1367 microversion: 2.1 time: 0.372127 Jun 21 18:39:07.822363 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 385/781] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:07 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1367 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:39:08.844813 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c0ecc0a0-56eb-40be-8f8e-271a75f52f62 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:08.846724 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c0ecc0a0-56eb-40be-8f8e-271a75f52f62 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:08.858720 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c0ecc0a0-56eb-40be-8f8e-271a75f52f62 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:08.859527 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c0ecc0a0-56eb-40be-8f8e-271a75f52f62 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:08.860561 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c0ecc0a0-56eb-40be-8f8e-271a75f52f62 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:08.861158 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c0ecc0a0-56eb-40be-8f8e-271a75f52f62 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:09.140452 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c0ecc0a0-56eb-40be-8f8e-271a75f52f62 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:39:09.155570 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c0ecc0a0-56eb-40be-8f8e-271a75f52f62 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1367 microversion: 2.1 time: 0.318273 Jun 21 18:39:09.159600 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 397/782] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:08 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1367 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:39:09.567507 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-96b7c9eb-7677-48a7-b3f1-e18f898215e4 req-caf0e1b8-cfdb-46d3-8e59-3125e0f83d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031fed05-1de1-49b6-8325-7a5ab4f19f1f", "name": "network-vif-plugged", "status": "completed", "tag": "561631ac-1f22-45ce-a83d-d5eb01c68fdb"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:39:09.582928 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-96b7c9eb-7677-48a7-b3f1-e18f898215e4 req-caf0e1b8-cfdb-46d3-8e59-3125e0f83d5e service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:09.583438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-96b7c9eb-7677-48a7-b3f1-e18f898215e4 req-caf0e1b8-cfdb-46d3-8e59-3125e0f83d5e service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:09.600302 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-96b7c9eb-7677-48a7-b3f1-e18f898215e4 req-caf0e1b8-cfdb-46d3-8e59-3125e0f83d5e service nova] Creating event network-vif-plugged:561631ac-1f22-45ce-a83d-d5eb01c68fdb for instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f on hv-cinder-84460 Jun 21 18:39:09.612461 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-96b7c9eb-7677-48a7-b3f1-e18f898215e4 req-caf0e1b8-cfdb-46d3-8e59-3125e0f83d5e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049091 Jun 21 18:39:09.613092 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 386/783] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:39:10.183322 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2f066c4f-b050-452a-8852-c07412a7cd82 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:10.184101 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-2f066c4f-b050-452a-8852-c07412a7cd82 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:10.188306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:39:10.198036 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2f066c4f-b050-452a-8852-c07412a7cd82 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:10.199244 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2f066c4f-b050-452a-8852-c07412a7cd82 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:10.200565 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2f066c4f-b050-452a-8852-c07412a7cd82 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:10.201593 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2f066c4f-b050-452a-8852-c07412a7cd82 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:10.232273 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=2 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:39:10.525151 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2f066c4f-b050-452a-8852-c07412a7cd82 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:39:10.539815 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-2f066c4f-b050-452a-8852-c07412a7cd82 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1367 microversion: 2.1 time: 0.362144 Jun 21 18:39:10.542137 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 398/784] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:10 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:39:11.567147 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=2 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:39:11.569762 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=10 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:39:11.581247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-0bc0d7d3-f9b2-43b1-97b5-c63fafe83164 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:11.583472 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-0bc0d7d3-f9b2-43b1-97b5-c63fafe83164 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:11.587450 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:39:11.600546 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0bc0d7d3-f9b2-43b1-97b5-c63fafe83164 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:11.601813 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0bc0d7d3-f9b2-43b1-97b5-c63fafe83164 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:11.603568 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0bc0d7d3-f9b2-43b1-97b5-c63fafe83164 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:11.604350 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0bc0d7d3-f9b2-43b1-97b5-c63fafe83164 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:11.888975 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-0bc0d7d3-f9b2-43b1-97b5-c63fafe83164 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:39:11.899613 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-0bc0d7d3-f9b2-43b1-97b5-c63fafe83164 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1367 microversion: 2.1 time: 0.334072 Jun 21 18:39:11.900569 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 387/785] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:11 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:39:12.927118 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-4c2eb6bb-f16c-4367-8f36-8219f45266bf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:12.928429 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-4c2eb6bb-f16c-4367-8f36-8219f45266bf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:12.936594 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4c2eb6bb-f16c-4367-8f36-8219f45266bf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:12.937063 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4c2eb6bb-f16c-4367-8f36-8219f45266bf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:12.938202 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4c2eb6bb-f16c-4367-8f36-8219f45266bf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:12.938672 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4c2eb6bb-f16c-4367-8f36-8219f45266bf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:13.179933 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-4c2eb6bb-f16c-4367-8f36-8219f45266bf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:39:13.191193 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-4c2eb6bb-f16c-4367-8f36-8219f45266bf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1556 microversion: 2.1 time: 0.268238 Jun 21 18:39:13.191786 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 399/786] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:39:12 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1556 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:39:13.209736 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f8ade5e5-9f18-4d4d-8e28-4c62034b4af6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:13.210546 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f8ade5e5-9f18-4d4d-8e28-4c62034b4af6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:13.217143 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f8ade5e5-9f18-4d4d-8e28-4c62034b4af6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:13.217593 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f8ade5e5-9f18-4d4d-8e28-4c62034b4af6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:13.218401 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f8ade5e5-9f18-4d4d-8e28-4c62034b4af6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:13.218863 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f8ade5e5-9f18-4d4d-8e28-4c62034b4af6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:13.566879 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f8ade5e5-9f18-4d4d-8e28-4c62034b4af6 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.361348 Jun 21 18:39:13.568653 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 388/787] 10.222.0.87 () {58 vars in 1274 bytes} [Tue Jun 21 18:39:13 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/os-interface => generated 284 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:39:15.549004 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-764c1cb2-255e-45bf-9b71-8357c81679ad req-0d11a060-b0d6-45a3-b134-f7607f8a7fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "031fed05-1de1-49b6-8325-7a5ab4f19f1f", "tag": "561631ac-1f22-45ce-a83d-d5eb01c68fdb"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:39:15.566230 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-764c1cb2-255e-45bf-9b71-8357c81679ad req-0d11a060-b0d6-45a3-b134-f7607f8a7fb7 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:15.567593 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-764c1cb2-255e-45bf-9b71-8357c81679ad req-0d11a060-b0d6-45a3-b134-f7607f8a7fb7 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:15.584061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-764c1cb2-255e-45bf-9b71-8357c81679ad req-0d11a060-b0d6-45a3-b134-f7607f8a7fb7 service nova] Creating event network-changed:561631ac-1f22-45ce-a83d-d5eb01c68fdb for instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f on hv-cinder-84460 Jun 21 18:39:15.592010 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-764c1cb2-255e-45bf-9b71-8357c81679ad req-0d11a060-b0d6-45a3-b134-f7607f8a7fb7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050502 Jun 21 18:39:15.592951 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 400/788] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:39:50.431131 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=3 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:39:50.432090 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=20 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:39:50.952907 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-85259921-4c08-4432-aa1a-dea8a7056c7b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:50.955458 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-85259921-4c08-4432-aa1a-dea8a7056c7b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:50.967516 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-85259921-4c08-4432-aa1a-dea8a7056c7b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:50.968448 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-85259921-4c08-4432-aa1a-dea8a7056c7b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:50.969862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-85259921-4c08-4432-aa1a-dea8a7056c7b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:50.970604 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-85259921-4c08-4432-aa1a-dea8a7056c7b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:51.007177 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-85259921-4c08-4432-aa1a-dea8a7056c7b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/ips" status: 200 len: 144 microversion: 2.1 time: 0.577852 Jun 21 18:39:51.008297 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 389/789] 10.222.0.87 () {58 vars in 1247 bytes} [Tue Jun 21 18:39:50 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/ips => generated 144 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:39:52.460035 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=5 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:39:52.461263 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=30 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:39:52.467059 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-afac39d1-8ed5-4475-b7c0-50249821a5fd tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71e2e96d-34c6-4961-8aa1-52a2b9be2e2d"}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:39:52.468656 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-afac39d1-8ed5-4475-b7c0-50249821a5fd tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:52.478167 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-afac39d1-8ed5-4475-b7c0-50249821a5fd tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:52.478685 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-afac39d1-8ed5-4475-b7c0-50249821a5fd tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:52.479616 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-afac39d1-8ed5-4475-b7c0-50249821a5fd tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:52.480106 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-afac39d1-8ed5-4475-b7c0-50249821a5fd tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:53.030152 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-afac39d1-8ed5-4475-b7c0-50249821a5fd tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "POST /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.571652 Jun 21 18:39:53.030943 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 401/790] 10.222.0.87 () {60 vars in 1322 bytes} [Tue Jun 21 18:39:52 2022] POST /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments => generated 194 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:39:57.503977 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-166c8339-0613-4c8b-9834-9e2a42cb4c4e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:57.504849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-166c8339-0613-4c8b-9834-9e2a42cb4c4e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:57.514419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-166c8339-0613-4c8b-9834-9e2a42cb4c4e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:57.515095 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-166c8339-0613-4c8b-9834-9e2a42cb4c4e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:57.516450 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-166c8339-0613-4c8b-9834-9e2a42cb4c4e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:57.517091 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-166c8339-0613-4c8b-9834-9e2a42cb4c4e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:57.548597 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-166c8339-0613-4c8b-9834-9e2a42cb4c4e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/ips" status: 200 len: 151 microversion: 2.20 time: 0.049708 Jun 21 18:39:57.549175 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 390/791] 10.222.0.87 () {60 vars in 1288 bytes} [Tue Jun 21 18:39:57 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/ips => generated 151 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:39:59.606806 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f39ba1f5-3857-46c1-84a6-c2625a9a01c2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:39:59.607579 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f39ba1f5-3857-46c1-84a6-c2625a9a01c2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:59.615789 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f39ba1f5-3857-46c1-84a6-c2625a9a01c2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:59.616230 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f39ba1f5-3857-46c1-84a6-c2625a9a01c2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:59.617057 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f39ba1f5-3857-46c1-84a6-c2625a9a01c2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:59.617589 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f39ba1f5-3857-46c1-84a6-c2625a9a01c2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:59.645515 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.objects.instance [None req-f39ba1f5-3857-46c1-84a6-c2625a9a01c2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lazy-loading 'flavor' on Instance uuid 4aab1542-b7fd-4057-9da2-8bcef1265883 {{(pid=118109) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:39:59.975972 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f39ba1f5-3857-46c1-84a6-c2625a9a01c2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "POST /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/action" status: 202 len: 0 microversion: 2.20 time: 0.374127 Jun 21 18:39:59.977326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 402/792] 10.222.0.87 () {62 vars in 1318 bytes} [Tue Jun 21 18:39:59 2022] POST /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:39:59.989812 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-ef4d68e4-9f21-41ef-88a1-a88aa67882a2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:39:59.990665 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-ef4d68e4-9f21-41ef-88a1-a88aa67882a2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:39:59.997892 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef4d68e4-9f21-41ef-88a1-a88aa67882a2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:59.998214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef4d68e4-9f21-41ef-88a1-a88aa67882a2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:39:59.999308 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef4d68e4-9f21-41ef-88a1-a88aa67882a2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:39:59.999977 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef4d68e4-9f21-41ef-88a1-a88aa67882a2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:00.184524 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ef4d68e4-9f21-41ef-88a1-a88aa67882a2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:00.194151 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ef4d68e4-9f21-41ef-88a1-a88aa67882a2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:00.196105 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ef4d68e4-9f21-41ef-88a1-a88aa67882a2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:00.197330 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-ef4d68e4-9f21-41ef-88a1-a88aa67882a2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1723 microversion: 2.20 time: 0.213441 Jun 21 18:40:00.197932 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 391/793] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:39:59 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:00.658337 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-d721c40e-53a4-4995-bdb2-453c9bc70ada tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:00.659638 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-d721c40e-53a4-4995-bdb2-453c9bc70ada tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:00.667727 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d721c40e-53a4-4995-bdb2-453c9bc70ada tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:00.668254 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d721c40e-53a4-4995-bdb2-453c9bc70ada tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:00.669081 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d721c40e-53a4-4995-bdb2-453c9bc70ada tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:00.669553 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d721c40e-53a4-4995-bdb2-453c9bc70ada tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:00.704919 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-d721c40e-53a4-4995-bdb2-453c9bc70ada tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051106 Jun 21 18:40:00.711861 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 403/794] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:40:00 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:40:00.721785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6f1890ed-fa7f-47ab-a242-f0bce63e33f1 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:00.722522 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-6f1890ed-fa7f-47ab-a242-f0bce63e33f1 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:00.730466 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6f1890ed-fa7f-47ab-a242-f0bce63e33f1 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:00.731052 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6f1890ed-fa7f-47ab-a242-f0bce63e33f1 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:00.731996 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6f1890ed-fa7f-47ab-a242-f0bce63e33f1 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:00.732551 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6f1890ed-fa7f-47ab-a242-f0bce63e33f1 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:00.767146 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6f1890ed-fa7f-47ab-a242-f0bce63e33f1 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments/71e2e96d-34c6-4961-8aa1-52a2b9be2e2d" status: 200 len: 194 microversion: 2.1 time: 0.051884 Jun 21 18:40:00.768409 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 392/795] 10.222.0.87 () {58 vars in 1412 bytes} [Tue Jun 21 18:40:00 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments/71e2e96d-34c6-4961-8aa1-52a2b9be2e2d => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:40:01.219616 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f94ec998-284a-460b-9539-ad7bb4c1ed9d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:01.220257 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f94ec998-284a-460b-9539-ad7bb4c1ed9d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:01.228640 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f94ec998-284a-460b-9539-ad7bb4c1ed9d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:01.229082 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f94ec998-284a-460b-9539-ad7bb4c1ed9d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:01.230346 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f94ec998-284a-460b-9539-ad7bb4c1ed9d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:01.230781 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f94ec998-284a-460b-9539-ad7bb4c1ed9d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:01.424763 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f94ec998-284a-460b-9539-ad7bb4c1ed9d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:01.435500 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f94ec998-284a-460b-9539-ad7bb4c1ed9d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:01.436996 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f94ec998-284a-460b-9539-ad7bb4c1ed9d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:01.438245 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f94ec998-284a-460b-9539-ad7bb4c1ed9d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1723 microversion: 2.20 time: 0.223303 Jun 21 18:40:01.438805 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 404/796] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:01 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:40:02.178827 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4e199cb5-3348-4991-bd2d-d03651670b90 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef0f35fc-0f3e-43aa-a1e7-245a2bd82594"}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:40:02.180338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4e199cb5-3348-4991-bd2d-d03651670b90 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:02.188129 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4e199cb5-3348-4991-bd2d-d03651670b90 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:02.188583 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4e199cb5-3348-4991-bd2d-d03651670b90 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:02.189379 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4e199cb5-3348-4991-bd2d-d03651670b90 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:02.189885 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4e199cb5-3348-4991-bd2d-d03651670b90 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:02.460688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-4881a055-4810-4814-8267-a656f71d0b34 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:02.461311 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-4881a055-4810-4814-8267-a656f71d0b34 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:02.469544 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4881a055-4810-4814-8267-a656f71d0b34 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:02.470014 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4881a055-4810-4814-8267-a656f71d0b34 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:02.470999 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4881a055-4810-4814-8267-a656f71d0b34 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:02.471551 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4881a055-4810-4814-8267-a656f71d0b34 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:02.544221 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4e199cb5-3348-4991-bd2d-d03651670b90 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "POST /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.370356 Jun 21 18:40:02.544968 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 393/797] 10.222.0.87 () {60 vars in 1322 bytes} [Tue Jun 21 18:40:02 2022] POST /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:40:02.697242 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-4881a055-4810-4814-8267-a656f71d0b34 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:02.709218 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-4881a055-4810-4814-8267-a656f71d0b34 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:02.712530 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-4881a055-4810-4814-8267-a656f71d0b34 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:02.715300 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-4881a055-4810-4814-8267-a656f71d0b34 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1723 microversion: 2.20 time: 0.258632 Jun 21 18:40:02.716184 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 405/798] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:02 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:40:03.745320 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-51807c59-acb2-4528-b566-1d5b48625f11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:03.746078 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-51807c59-acb2-4528-b566-1d5b48625f11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:03.753421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-51807c59-acb2-4528-b566-1d5b48625f11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:03.753904 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-51807c59-acb2-4528-b566-1d5b48625f11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:03.754689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-51807c59-acb2-4528-b566-1d5b48625f11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:03.755116 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-51807c59-acb2-4528-b566-1d5b48625f11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:03.952280 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-51807c59-acb2-4528-b566-1d5b48625f11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:03.963237 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-51807c59-acb2-4528-b566-1d5b48625f11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:03.964932 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-51807c59-acb2-4528-b566-1d5b48625f11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:03.966194 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-51807c59-acb2-4528-b566-1d5b48625f11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1723 microversion: 2.20 time: 0.226186 Jun 21 18:40:03.966778 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 394/799] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:03 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:04.986132 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-5604259a-e666-4294-a1cd-da1c4eee5b6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:04.986881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-5604259a-e666-4294-a1cd-da1c4eee5b6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:04.996243 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5604259a-e666-4294-a1cd-da1c4eee5b6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:04.996243 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5604259a-e666-4294-a1cd-da1c4eee5b6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:04.996243 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5604259a-e666-4294-a1cd-da1c4eee5b6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:04.996747 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-5604259a-e666-4294-a1cd-da1c4eee5b6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:05.148836 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-5604259a-e666-4294-a1cd-da1c4eee5b6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:05.157886 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-5604259a-e666-4294-a1cd-da1c4eee5b6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:05.159908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-5604259a-e666-4294-a1cd-da1c4eee5b6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:05.161136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-5604259a-e666-4294-a1cd-da1c4eee5b6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1723 microversion: 2.20 time: 0.179196 Jun 21 18:40:05.162007 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 406/800] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:04 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:06.181666 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-611ef02c-ca33-4b83-bdd5-4554688fd72f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:06.182282 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-611ef02c-ca33-4b83-bdd5-4554688fd72f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:06.189773 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-611ef02c-ca33-4b83-bdd5-4554688fd72f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:06.190216 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-611ef02c-ca33-4b83-bdd5-4554688fd72f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:06.191197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-611ef02c-ca33-4b83-bdd5-4554688fd72f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:06.191637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-611ef02c-ca33-4b83-bdd5-4554688fd72f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:06.363698 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-611ef02c-ca33-4b83-bdd5-4554688fd72f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:06.373393 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-611ef02c-ca33-4b83-bdd5-4554688fd72f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:06.375091 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-611ef02c-ca33-4b83-bdd5-4554688fd72f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:06.376345 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-611ef02c-ca33-4b83-bdd5-4554688fd72f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1723 microversion: 2.20 time: 0.198952 Jun 21 18:40:06.377013 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 395/801] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:06 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:07.397314 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-771b8b42-7f19-4067-96e1-16a05ce37702 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:07.398025 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-771b8b42-7f19-4067-96e1-16a05ce37702 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:07.406018 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-771b8b42-7f19-4067-96e1-16a05ce37702 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:07.406466 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-771b8b42-7f19-4067-96e1-16a05ce37702 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:07.407273 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-771b8b42-7f19-4067-96e1-16a05ce37702 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:07.407689 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-771b8b42-7f19-4067-96e1-16a05ce37702 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:07.586970 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-771b8b42-7f19-4067-96e1-16a05ce37702 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:07.596453 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-771b8b42-7f19-4067-96e1-16a05ce37702 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:07.598416 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-771b8b42-7f19-4067-96e1-16a05ce37702 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:07.599654 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-771b8b42-7f19-4067-96e1-16a05ce37702 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1723 microversion: 2.20 time: 0.207271 Jun 21 18:40:07.600223 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 407/802] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:07 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:08.619416 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-3128215e-e263-4df8-a108-9986ea04713e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:08.620327 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-3128215e-e263-4df8-a108-9986ea04713e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:08.628217 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3128215e-e263-4df8-a108-9986ea04713e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:08.628680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3128215e-e263-4df8-a108-9986ea04713e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:08.629476 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3128215e-e263-4df8-a108-9986ea04713e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:08.629984 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3128215e-e263-4df8-a108-9986ea04713e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:08.785564 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-3128215e-e263-4df8-a108-9986ea04713e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:08.794626 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-3128215e-e263-4df8-a108-9986ea04713e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:08.796147 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-3128215e-e263-4df8-a108-9986ea04713e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:08.797347 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-3128215e-e263-4df8-a108-9986ea04713e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1723 microversion: 2.20 time: 0.182471 Jun 21 18:40:08.797957 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 396/803] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:08 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:09.822155 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1b566280-fda2-4d93-9fe2-8258b0cb3168 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:09.823230 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1b566280-fda2-4d93-9fe2-8258b0cb3168 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:09.834328 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b566280-fda2-4d93-9fe2-8258b0cb3168 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:09.834922 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b566280-fda2-4d93-9fe2-8258b0cb3168 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:09.836064 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b566280-fda2-4d93-9fe2-8258b0cb3168 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:09.836794 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b566280-fda2-4d93-9fe2-8258b0cb3168 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:09.991877 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1b566280-fda2-4d93-9fe2-8258b0cb3168 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:10.001014 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1b566280-fda2-4d93-9fe2-8258b0cb3168 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:10.003393 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1b566280-fda2-4d93-9fe2-8258b0cb3168 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:10.004586 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1b566280-fda2-4d93-9fe2-8258b0cb3168 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1723 microversion: 2.20 time: 0.190613 Jun 21 18:40:10.005157 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 408/804] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:09 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:10.163176 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b70868f3-d535-45a4-8d43-dd5140d45112 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:10.165068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b70868f3-d535-45a4-8d43-dd5140d45112 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:10.173703 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b70868f3-d535-45a4-8d43-dd5140d45112 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:10.174189 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b70868f3-d535-45a4-8d43-dd5140d45112 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:10.174964 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b70868f3-d535-45a4-8d43-dd5140d45112 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:10.175428 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b70868f3-d535-45a4-8d43-dd5140d45112 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:10.210520 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b70868f3-d535-45a4-8d43-dd5140d45112 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052184 Jun 21 18:40:10.211084 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 397/805] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:40:10 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:40:10.360969 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a16140b4-37a1-4f58-9d35-187b3741efdb tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:10.361578 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-a16140b4-37a1-4f58-9d35-187b3741efdb tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:10.368519 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a16140b4-37a1-4f58-9d35-187b3741efdb tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:10.368959 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a16140b4-37a1-4f58-9d35-187b3741efdb tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:10.369752 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a16140b4-37a1-4f58-9d35-187b3741efdb tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:10.370181 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a16140b4-37a1-4f58-9d35-187b3741efdb tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:10.566839 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-a16140b4-37a1-4f58-9d35-187b3741efdb tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments/71e2e96d-34c6-4961-8aa1-52a2b9be2e2d" status: 200 len: 194 microversion: 2.1 time: 0.210050 Jun 21 18:40:10.567477 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 409/806] 10.222.0.87 () {58 vars in 1412 bytes} [Tue Jun 21 18:40:10 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments/71e2e96d-34c6-4961-8aa1-52a2b9be2e2d => generated 194 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:40:10.577423 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4751b75b-ea7d-47f2-824d-99ba10e5769a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:10.577984 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4751b75b-ea7d-47f2-824d-99ba10e5769a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:10.584999 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4751b75b-ea7d-47f2-824d-99ba10e5769a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:10.585449 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4751b75b-ea7d-47f2-824d-99ba10e5769a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:10.586272 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4751b75b-ea7d-47f2-824d-99ba10e5769a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:10.586711 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4751b75b-ea7d-47f2-824d-99ba10e5769a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:10.702329 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.objects.instance [None req-4751b75b-ea7d-47f2-824d-99ba10e5769a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lazy-loading 'services' on Instance uuid c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 {{(pid=118108) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:40:10.791261 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4751b75b-ea7d-47f2-824d-99ba10e5769a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments/71e2e96d-34c6-4961-8aa1-52a2b9be2e2d" status: 202 len: 0 microversion: 2.1 time: 0.217504 Jun 21 18:40:10.792075 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 398/807] 10.222.0.87 () {58 vars in 1415 bytes} [Tue Jun 21 18:40:10 2022] DELETE /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments/71e2e96d-34c6-4961-8aa1-52a2b9be2e2d => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:40:11.023128 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-607b47d2-ab17-4ef2-a1ca-9e3e79c9725e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:11.023750 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-607b47d2-ab17-4ef2-a1ca-9e3e79c9725e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:11.030793 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-607b47d2-ab17-4ef2-a1ca-9e3e79c9725e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:11.031592 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-607b47d2-ab17-4ef2-a1ca-9e3e79c9725e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:11.032374 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-607b47d2-ab17-4ef2-a1ca-9e3e79c9725e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:11.032856 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-607b47d2-ab17-4ef2-a1ca-9e3e79c9725e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:11.207156 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-607b47d2-ab17-4ef2-a1ca-9e3e79c9725e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:11.215746 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-607b47d2-ab17-4ef2-a1ca-9e3e79c9725e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:11.217269 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-607b47d2-ab17-4ef2-a1ca-9e3e79c9725e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:11.218472 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-607b47d2-ab17-4ef2-a1ca-9e3e79c9725e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1723 microversion: 2.20 time: 0.199533 Jun 21 18:40:11.219031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 410/808] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:11 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:40:12.240800 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-ccc714ae-239e-4946-981d-65a0dfcddb66 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:12.241967 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-ccc714ae-239e-4946-981d-65a0dfcddb66 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:12.251405 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ccc714ae-239e-4946-981d-65a0dfcddb66 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:12.251876 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ccc714ae-239e-4946-981d-65a0dfcddb66 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:12.252762 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ccc714ae-239e-4946-981d-65a0dfcddb66 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:12.253129 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ccc714ae-239e-4946-981d-65a0dfcddb66 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:12.440744 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ccc714ae-239e-4946-981d-65a0dfcddb66 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:12.450841 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ccc714ae-239e-4946-981d-65a0dfcddb66 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:12.452354 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ccc714ae-239e-4946-981d-65a0dfcddb66 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:12.453558 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-ccc714ae-239e-4946-981d-65a0dfcddb66 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1744 microversion: 2.20 time: 0.219635 Jun 21 18:40:12.457269 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 399/809] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:12 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1744 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:40:12.999671 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-532d4b0f-c274-4744-a776-d476a6ec4815 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:13.000550 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-532d4b0f-c274-4744-a776-d476a6ec4815 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:13.009412 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-532d4b0f-c274-4744-a776-d476a6ec4815 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:13.009961 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-532d4b0f-c274-4744-a776-d476a6ec4815 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:13.010814 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-532d4b0f-c274-4744-a776-d476a6ec4815 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:13.011291 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-532d4b0f-c274-4744-a776-d476a6ec4815 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:13.046158 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-532d4b0f-c274-4744-a776-d476a6ec4815 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments/ef0f35fc-0f3e-43aa-a1e7-245a2bd82594" status: 200 len: 194 microversion: 2.1 time: 0.051300 Jun 21 18:40:13.046762 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 411/810] 10.222.0.87 () {58 vars in 1412 bytes} [Tue Jun 21 18:40:12 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments/ef0f35fc-0f3e-43aa-a1e7-245a2bd82594 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:40:13.057369 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c5f176b8-a7a9-4e14-8525-c60e08acba80 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:13.057901 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c5f176b8-a7a9-4e14-8525-c60e08acba80 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:13.064396 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c5f176b8-a7a9-4e14-8525-c60e08acba80 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:13.064840 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c5f176b8-a7a9-4e14-8525-c60e08acba80 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:13.065717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c5f176b8-a7a9-4e14-8525-c60e08acba80 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:13.066161 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c5f176b8-a7a9-4e14-8525-c60e08acba80 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:13.164970 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.objects.instance [None req-c5f176b8-a7a9-4e14-8525-c60e08acba80 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lazy-loading 'services' on Instance uuid c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 {{(pid=118108) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:40:13.261734 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c5f176b8-a7a9-4e14-8525-c60e08acba80 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments/ef0f35fc-0f3e-43aa-a1e7-245a2bd82594" status: 202 len: 0 microversion: 2.1 time: 0.208209 Jun 21 18:40:13.262641 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 400/811] 10.222.0.87 () {58 vars in 1415 bytes} [Tue Jun 21 18:40:13 2022] DELETE /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments/ef0f35fc-0f3e-43aa-a1e7-245a2bd82594 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:40:13.477155 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f3099e29-343e-4b98-aead-a306cb2d3d6e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:13.478079 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f3099e29-343e-4b98-aead-a306cb2d3d6e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:13.485245 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f3099e29-343e-4b98-aead-a306cb2d3d6e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:13.485699 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f3099e29-343e-4b98-aead-a306cb2d3d6e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:13.486859 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f3099e29-343e-4b98-aead-a306cb2d3d6e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:13.487568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f3099e29-343e-4b98-aead-a306cb2d3d6e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:13.650279 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f3099e29-343e-4b98-aead-a306cb2d3d6e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:13.666813 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f3099e29-343e-4b98-aead-a306cb2d3d6e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:13.670252 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f3099e29-343e-4b98-aead-a306cb2d3d6e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:13.672376 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f3099e29-343e-4b98-aead-a306cb2d3d6e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1744 microversion: 2.20 time: 0.199619 Jun 21 18:40:13.673293 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 412/812] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:13 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1744 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:14.479478 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-978cd99c-4c71-432c-a7d2-26c2c6c7d17a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:14.481394 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-978cd99c-4c71-432c-a7d2-26c2c6c7d17a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:14.493382 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-978cd99c-4c71-432c-a7d2-26c2c6c7d17a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:14.493966 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-978cd99c-4c71-432c-a7d2-26c2c6c7d17a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:14.494929 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-978cd99c-4c71-432c-a7d2-26c2c6c7d17a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:14.495402 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-978cd99c-4c71-432c-a7d2-26c2c6c7d17a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:14.530758 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-978cd99c-4c71-432c-a7d2-26c2c6c7d17a tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059324 Jun 21 18:40:14.531342 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 401/813] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:40:14 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 18:40:14.652698 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-87701492-f07a-4aae-8dfb-c1f34db1eba4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:14.653809 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-87701492-f07a-4aae-8dfb-c1f34db1eba4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:14.662028 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-87701492-f07a-4aae-8dfb-c1f34db1eba4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:14.662474 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-87701492-f07a-4aae-8dfb-c1f34db1eba4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:14.663302 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-87701492-f07a-4aae-8dfb-c1f34db1eba4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:14.663750 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-87701492-f07a-4aae-8dfb-c1f34db1eba4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:14.699205 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-8025e3c4-bd9f-4544-af50-8cbb049113f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:14.700139 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-8025e3c4-bd9f-4544-af50-8cbb049113f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:14.702769 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-87701492-f07a-4aae-8dfb-c1f34db1eba4 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053906 Jun 21 18:40:14.704296 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 413/814] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:40:14 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 18:40:14.712412 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8025e3c4-bd9f-4544-af50-8cbb049113f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:14.713150 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8025e3c4-bd9f-4544-af50-8cbb049113f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:14.714448 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8025e3c4-bd9f-4544-af50-8cbb049113f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:14.715152 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8025e3c4-bd9f-4544-af50-8cbb049113f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:14.800596 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b4694cf8-6f0b-43dc-bba4-9e11025502b6 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:14.801508 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b4694cf8-6f0b-43dc-bba4-9e11025502b6 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:14.812835 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b4694cf8-6f0b-43dc-bba4-9e11025502b6 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:14.813611 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b4694cf8-6f0b-43dc-bba4-9e11025502b6 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:14.816296 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b4694cf8-6f0b-43dc-bba4-9e11025502b6 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:14.817018 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b4694cf8-6f0b-43dc-bba4-9e11025502b6 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:14.824668 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:40:14.863318 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b4694cf8-6f0b-43dc-bba4-9e11025502b6 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Going to try to terminate instance {{(pid=118109) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:40:14.934200 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-8025e3c4-bd9f-4544-af50-8cbb049113f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:14.951179 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-8025e3c4-bd9f-4544-af50-8cbb049113f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:14.954678 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-8025e3c4-bd9f-4544-af50-8cbb049113f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:14.957209 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-8025e3c4-bd9f-4544-af50-8cbb049113f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1744 microversion: 2.20 time: 0.264288 Jun 21 18:40:14.958272 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 402/815] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:14 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1744 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:40:14.993817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b4694cf8-6f0b-43dc-bba4-9e11025502b6 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148" status: 204 len: 0 microversion: 2.1 time: 0.201379 Jun 21 18:40:14.994598 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 414/816] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:40:14 2022] DELETE /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:40:15.004313 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5a31c7c3-0ea3-40e0-bf2f-3741338d0d58 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:15.005014 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-5a31c7c3-0ea3-40e0-bf2f-3741338d0d58 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:15.014829 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5a31c7c3-0ea3-40e0-bf2f-3741338d0d58 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:15.015708 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5a31c7c3-0ea3-40e0-bf2f-3741338d0d58 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:15.016620 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5a31c7c3-0ea3-40e0-bf2f-3741338d0d58 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:15.017116 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5a31c7c3-0ea3-40e0-bf2f-3741338d0d58 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:15.039597 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:40:15.187939 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-5a31c7c3-0ea3-40e0-bf2f-3741338d0d58 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:15.196966 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-5a31c7c3-0ea3-40e0-bf2f-3741338d0d58 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148" status: 200 len: 1670 microversion: 2.1 time: 0.197491 Jun 21 18:40:15.197556 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 403/817] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:40:14 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 => generated 1670 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:40:15.791728 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-c1ea2b3d-7f5d-4e3d-a43c-f13d1da0eb9e req-80b49180-aae4-4e42-8196-8af7c5204bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aab1542-b7fd-4057-9da2-8bcef1265883", "name": "network-vif-plugged", "status": "completed", "tag": "c320e6d5-945e-46d1-b2a9-bf683bd75477"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:40:15.808861 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-c1ea2b3d-7f5d-4e3d-a43c-f13d1da0eb9e req-80b49180-aae4-4e42-8196-8af7c5204bbe service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:15.809609 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-c1ea2b3d-7f5d-4e3d-a43c-f13d1da0eb9e req-80b49180-aae4-4e42-8196-8af7c5204bbe service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:15.835133 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-c1ea2b3d-7f5d-4e3d-a43c-f13d1da0eb9e req-80b49180-aae4-4e42-8196-8af7c5204bbe service nova] Creating event network-vif-plugged:c320e6d5-945e-46d1-b2a9-bf683bd75477 for instance 4aab1542-b7fd-4057-9da2-8bcef1265883 on hv-cinder-84460 Jun 21 18:40:15.844659 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-c1ea2b3d-7f5d-4e3d-a43c-f13d1da0eb9e req-80b49180-aae4-4e42-8196-8af7c5204bbe service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060014 Jun 21 18:40:15.847269 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 415/818] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:40:15.986673 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-84e193bd-bd69-4bb4-95d5-f1eb4f463dd0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:15.987690 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-84e193bd-bd69-4bb4-95d5-f1eb4f463dd0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:15.995881 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-84e193bd-bd69-4bb4-95d5-f1eb4f463dd0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:15.996321 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-84e193bd-bd69-4bb4-95d5-f1eb4f463dd0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:15.997142 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-84e193bd-bd69-4bb4-95d5-f1eb4f463dd0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:15.997611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-84e193bd-bd69-4bb4-95d5-f1eb4f463dd0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:16.158996 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-84e193bd-bd69-4bb4-95d5-f1eb4f463dd0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:16.168130 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-84e193bd-bd69-4bb4-95d5-f1eb4f463dd0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:16.169683 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-84e193bd-bd69-4bb4-95d5-f1eb4f463dd0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:16.170934 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-84e193bd-bd69-4bb4-95d5-f1eb4f463dd0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1744 microversion: 2.20 time: 0.188690 Jun 21 18:40:16.171490 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 404/819] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:15 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1744 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:16.215831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-7680ab0f-4710-449d-b598-f072dcdef967 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:16.216654 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-7680ab0f-4710-449d-b598-f072dcdef967 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:16.224335 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7680ab0f-4710-449d-b598-f072dcdef967 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:16.224774 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7680ab0f-4710-449d-b598-f072dcdef967 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:16.225572 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7680ab0f-4710-449d-b598-f072dcdef967 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:16.226022 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7680ab0f-4710-449d-b598-f072dcdef967 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:16.399297 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-7680ab0f-4710-449d-b598-f072dcdef967 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:16.408494 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-7680ab0f-4710-449d-b598-f072dcdef967 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148" status: 200 len: 1670 microversion: 2.1 time: 0.196974 Jun 21 18:40:16.409081 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 416/820] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:40:16 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 => generated 1670 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:40:17.190574 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-270d1361-5511-4f42-b4b4-9af6d5af15dc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:17.191237 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-270d1361-5511-4f42-b4b4-9af6d5af15dc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:17.198631 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-270d1361-5511-4f42-b4b4-9af6d5af15dc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:17.199083 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-270d1361-5511-4f42-b4b4-9af6d5af15dc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:17.200058 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-270d1361-5511-4f42-b4b4-9af6d5af15dc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:17.200503 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-270d1361-5511-4f42-b4b4-9af6d5af15dc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:17.359118 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-270d1361-5511-4f42-b4b4-9af6d5af15dc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:17.369729 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-270d1361-5511-4f42-b4b4-9af6d5af15dc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:17.371396 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-270d1361-5511-4f42-b4b4-9af6d5af15dc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:17.372666 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-270d1361-5511-4f42-b4b4-9af6d5af15dc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1744 microversion: 2.20 time: 0.186450 Jun 21 18:40:17.373264 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 405/821] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:17 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1744 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:17.427033 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-44fb33ef-03da-4202-8453-48cc2e273c5b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:17.427698 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-44fb33ef-03da-4202-8453-48cc2e273c5b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:17.435601 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-44fb33ef-03da-4202-8453-48cc2e273c5b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:17.436097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-44fb33ef-03da-4202-8453-48cc2e273c5b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:17.436967 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-44fb33ef-03da-4202-8453-48cc2e273c5b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:17.437454 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-44fb33ef-03da-4202-8453-48cc2e273c5b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:17.608553 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-44fb33ef-03da-4202-8453-48cc2e273c5b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:17.617543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-44fb33ef-03da-4202-8453-48cc2e273c5b tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148" status: 200 len: 1670 microversion: 2.1 time: 0.194756 Jun 21 18:40:17.618188 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 417/822] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:40:17 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 => generated 1670 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:40:18.394680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-284f8a59-193e-495a-8166-c50ce0cf24bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:18.395449 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-284f8a59-193e-495a-8166-c50ce0cf24bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:18.403364 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-284f8a59-193e-495a-8166-c50ce0cf24bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:18.403946 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-284f8a59-193e-495a-8166-c50ce0cf24bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:18.405078 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-284f8a59-193e-495a-8166-c50ce0cf24bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:18.405586 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-284f8a59-193e-495a-8166-c50ce0cf24bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:18.629174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-284f8a59-193e-495a-8166-c50ce0cf24bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:18.637827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bd57b461-c380-4b8b-a891-33e1ff6bca36 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:18.645885 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-bd57b461-c380-4b8b-a891-33e1ff6bca36 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:18.650393 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bd57b461-c380-4b8b-a891-33e1ff6bca36 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:18.650838 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bd57b461-c380-4b8b-a891-33e1ff6bca36 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:18.651630 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bd57b461-c380-4b8b-a891-33e1ff6bca36 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:18.652060 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bd57b461-c380-4b8b-a891-33e1ff6bca36 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:18.659334 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-284f8a59-193e-495a-8166-c50ce0cf24bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:18.662688 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-284f8a59-193e-495a-8166-c50ce0cf24bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:18.664772 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-284f8a59-193e-495a-8166-c50ce0cf24bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1744 microversion: 2.20 time: 0.275383 Jun 21 18:40:18.665927 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 406/823] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:18 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1744 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:40:18.732735 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-bd57b461-c380-4b8b-a891-33e1ff6bca36 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf9a33e9fb941939010989a89a51d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c88935a83d24e408c99cb711ae46257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:18.741083 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-bd57b461-c380-4b8b-a891-33e1ff6bca36 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148" status: 200 len: 1603 microversion: 2.1 time: 0.108330 Jun 21 18:40:18.741934 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 418/824] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:40:18 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 => generated 1603 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:40:18.931789 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-fd329dac-b764-439c-a5cc-22155a604ca1 req-e38b3fa0-3d59-4566-822d-2e8e99fd6806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42fc280-3e6d-4ac0-8b86-d7d69dc8f148", "name": "network-vif-deleted", "tag": "da5e8ac4-f318-4263-b7b5-fc58bd1bdf39"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:40:18.951293 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-fd329dac-b764-439c-a5cc-22155a604ca1 req-e38b3fa0-3d59-4566-822d-2e8e99fd6806 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:18.951732 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-fd329dac-b764-439c-a5cc-22155a604ca1 req-e38b3fa0-3d59-4566-822d-2e8e99fd6806 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:18.971990 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-fd329dac-b764-439c-a5cc-22155a604ca1 req-e38b3fa0-3d59-4566-822d-2e8e99fd6806 service nova] Creating event network-vif-deleted:da5e8ac4-f318-4263-b7b5-fc58bd1bdf39 for instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 on hv-cinder-84460 Jun 21 18:40:18.979102 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-fd329dac-b764-439c-a5cc-22155a604ca1 req-e38b3fa0-3d59-4566-822d-2e8e99fd6806 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050869 Jun 21 18:40:18.980396 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 407/825] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:40:19.687897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-0fbaae07-9777-4ed2-8675-b9359f80902b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:19.689213 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-0fbaae07-9777-4ed2-8675-b9359f80902b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:19.703702 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0fbaae07-9777-4ed2-8675-b9359f80902b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:19.704356 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0fbaae07-9777-4ed2-8675-b9359f80902b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:19.707010 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0fbaae07-9777-4ed2-8675-b9359f80902b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:19.707820 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0fbaae07-9777-4ed2-8675-b9359f80902b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:19.761014 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-8db1bf43-4440-4d2c-ac46-93f77fcea06e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:19.761816 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-8db1bf43-4440-4d2c-ac46-93f77fcea06e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:19.770507 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8db1bf43-4440-4d2c-ac46-93f77fcea06e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:19.770856 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8db1bf43-4440-4d2c-ac46-93f77fcea06e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:19.771604 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8db1bf43-4440-4d2c-ac46-93f77fcea06e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:19.772052 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8db1bf43-4440-4d2c-ac46-93f77fcea06e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:19.793085 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-8db1bf43-4440-4d2c-ac46-93f77fcea06e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] HTTP exception thrown: Instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 could not be found. Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-8db1bf43-4440-4d2c-ac46-93f77fcea06e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Request method failure captured: Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 HTTP/1.1 Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABisg4b5iP8NqvQaqLZMQOX17D08o8A7fg9Ot-ige1NWhVqvFHnDB3G6E_m1QKnYBakDyNPFWwu87nrNNsP8iUhNHwlm0pC00yNjpiKUa5c2iDV--laqn2ubVFlmaxemMBDeDKwfXSe867iALKtJnevww3w_urmBkmsubhnfWkrOl-c4ZI Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 3c88935a83d24e408c99cb711ae46257 Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-AttachVolumeTestJSON-1959880149 Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:40:19.795207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:40:19.797869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c88935a83d24e408c99cb711ae46257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c88935a83d24e408c99cb711ae46257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c88935a83d24e408c99cb711ae46257"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c88935a83d24e408c99cb711ae46257"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:40:19.797869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-AttachVolumeTestJSON-1959880149 Jun 21 18:40:19.797869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 3c88935a83d24e408c99cb711ae46257 Jun 21 18:40:19.797869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1959880149 Jun 21 18:40:19.797869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-AttachVolumeTestJSON-1959880149-project Jun 21 18:40:19.797869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:40:19.797869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:40:19.797869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: acf9a33e9fb941939010989a89a51d38 Jun 21 18:40:19.797869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-AttachVolumeTestJSON-1959880149-project Jun 21 18:40:19.797869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:40:19.797869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 could not be found. Jun 21 18:40:19.797869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': 'c42fc280-3e6d-4ac0-8b86-d7d69dc8f148'} Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 could not be found. Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:40:19.799433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:40:19.801530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:40:19.801530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:40:19.801530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:40:19.801530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:40:19.801530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:40:19.801530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:40:19.801530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:40:19.801530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 could not be found. Jun 21 18:40:19.801530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:19.801530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:19.801530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:19.801530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:19.801530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:19.801530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:19.801530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:40:19.801530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:40:19.801530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 could not be found. Jun 21 18:40:19.801530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:19.803372 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-8db1bf43-4440-4d2c-ac46-93f77fcea06e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Returning 404 to user: Instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:40:19.803372 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-8db1bf43-4440-4d2c-ac46-93f77fcea06e tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148" status: 404 len: 111 microversion: 2.1 time: 0.041220 Jun 21 18:40:19.803372 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 408/826] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:40:19 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 18:40:19.810695 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-9088952a-8bd0-465f-8c3c-2f3ee4466ed0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '.version_select at 0x7fd8bb8ba160>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:19.849720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-9088952a-8bd0-465f-8c3c-2f3ee4466ed0 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-291766471" status: 202 len: 0 microversion: 2.1 time: 0.046143 Jun 21 18:40:19.851247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 409/827] 10.222.0.87 () {58 vars in 1217 bytes} [Tue Jun 21 18:40:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-291766471 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:40:19.940080 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-0fbaae07-9777-4ed2-8675-b9359f80902b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:19.957472 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-0fbaae07-9777-4ed2-8675-b9359f80902b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:19.960909 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-0fbaae07-9777-4ed2-8675-b9359f80902b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:19.963306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-0fbaae07-9777-4ed2-8675-b9359f80902b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1744 microversion: 2.20 time: 0.282367 Jun 21 18:40:19.978354 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 419/828] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:19 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1744 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:20.996909 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-94a2eb6e-701b-4624-879f-3667fd18ac16 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:21.005113 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-94a2eb6e-701b-4624-879f-3667fd18ac16 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:21.012943 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:40:21.054000 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-94a2eb6e-701b-4624-879f-3667fd18ac16 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:21.054000 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-94a2eb6e-701b-4624-879f-3667fd18ac16 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:21.054000 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-94a2eb6e-701b-4624-879f-3667fd18ac16 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:21.054000 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-94a2eb6e-701b-4624-879f-3667fd18ac16 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:21.295623 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-94a2eb6e-701b-4624-879f-3667fd18ac16 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:21.316598 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-94a2eb6e-701b-4624-879f-3667fd18ac16 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:21.320781 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-94a2eb6e-701b-4624-879f-3667fd18ac16 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:21.323794 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-94a2eb6e-701b-4624-879f-3667fd18ac16 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1739 microversion: 2.20 time: 0.333613 Jun 21 18:40:21.325034 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 410/829] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:20 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1739 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:22.344339 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e0a462e4-b888-478b-868a-19e94e6485b2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:22.345246 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e0a462e4-b888-478b-868a-19e94e6485b2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:22.352287 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e0a462e4-b888-478b-868a-19e94e6485b2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:22.353051 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e0a462e4-b888-478b-868a-19e94e6485b2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:22.354086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e0a462e4-b888-478b-868a-19e94e6485b2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:22.354517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e0a462e4-b888-478b-868a-19e94e6485b2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:22.566690 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e0a462e4-b888-478b-868a-19e94e6485b2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:22.583669 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e0a462e4-b888-478b-868a-19e94e6485b2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:22.585973 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e0a462e4-b888-478b-868a-19e94e6485b2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:22.587641 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e0a462e4-b888-478b-868a-19e94e6485b2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1739 microversion: 2.20 time: 0.247262 Jun 21 18:40:22.603192 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 420/830] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:22 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:40:23.321368 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a2abbd5e-b3b2-4e2f-a64b-18928da92793 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:23.322209 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-a2abbd5e-b3b2-4e2f-a64b-18928da92793 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:23.332949 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a2abbd5e-b3b2-4e2f-a64b-18928da92793 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:23.333395 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a2abbd5e-b3b2-4e2f-a64b-18928da92793 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:23.334433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a2abbd5e-b3b2-4e2f-a64b-18928da92793 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:23.334869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a2abbd5e-b3b2-4e2f-a64b-18928da92793 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:23.350795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-a2abbd5e-b3b2-4e2f-a64b-18928da92793 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] HTTP exception thrown: Instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 could not be found. Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a2abbd5e-b3b2-4e2f-a64b-18928da92793 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Request method failure captured: Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: DELETE /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 HTTP/1.1 Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABisg4b5iP8NqvQaqLZMQOX17D08o8A7fg9Ot-ige1NWhVqvFHnDB3G6E_m1QKnYBakDyNPFWwu87nrNNsP8iUhNHwlm0pC00yNjpiKUa5c2iDV--laqn2ubVFlmaxemMBDeDKwfXSe867iALKtJnevww3w_urmBkmsubhnfWkrOl-c4ZI Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 3c88935a83d24e408c99cb711ae46257 Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-AttachVolumeTestJSON-1959880149 Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:40:23.352791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:40:23.360680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c88935a83d24e408c99cb711ae46257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c88935a83d24e408c99cb711ae46257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c88935a83d24e408c99cb711ae46257"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c88935a83d24e408c99cb711ae46257"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:40:23.360680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-AttachVolumeTestJSON-1959880149 Jun 21 18:40:23.360680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 3c88935a83d24e408c99cb711ae46257 Jun 21 18:40:23.360680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1959880149 Jun 21 18:40:23.360680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-AttachVolumeTestJSON-1959880149-project Jun 21 18:40:23.360680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:40:23.360680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:40:23.360680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: acf9a33e9fb941939010989a89a51d38 Jun 21 18:40:23.360680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-AttachVolumeTestJSON-1959880149-project Jun 21 18:40:23.360680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:40:23.360680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 could not be found. Jun 21 18:40:23.360680 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': 'c42fc280-3e6d-4ac0-8b86-d7d69dc8f148'} Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 could not be found. Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:40:23.362637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 could not be found. Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 could not be found. Jun 21 18:40:23.365535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:23.368722 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a2abbd5e-b3b2-4e2f-a64b-18928da92793 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Returning 404 to user: Instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:40:23.368722 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a2abbd5e-b3b2-4e2f-a64b-18928da92793 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "DELETE /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148" status: 404 len: 111 microversion: 2.1 time: 0.037006 Jun 21 18:40:23.368722 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 411/831] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:40:23 2022] DELETE /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 18:40:23.369149 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e8ead374-4564-44f6-a3fc-96fc36a85728 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:23.369149 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e8ead374-4564-44f6-a3fc-96fc36a85728 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: c42fc280-3e6d-4ac0-8b86-d7d69dc8f148] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:23.372905 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:40:23.375136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e8ead374-4564-44f6-a3fc-96fc36a85728 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:23.375581 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e8ead374-4564-44f6-a3fc-96fc36a85728 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:23.376653 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e8ead374-4564-44f6-a3fc-96fc36a85728 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:23.377279 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e8ead374-4564-44f6-a3fc-96fc36a85728 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:23.397229 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-e8ead374-4564-44f6-a3fc-96fc36a85728 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] HTTP exception thrown: Instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 could not be found. Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e8ead374-4564-44f6-a3fc-96fc36a85728 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Request method failure captured: Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 HTTP/1.1 Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg4b5iP8NqvQaqLZMQOX17D08o8A7fg9Ot-ige1NWhVqvFHnDB3G6E_m1QKnYBakDyNPFWwu87nrNNsP8iUhNHwlm0pC00yNjpiKUa5c2iDV--laqn2ubVFlmaxemMBDeDKwfXSe867iALKtJnevww3w_urmBkmsubhnfWkrOl-c4ZI Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 3c88935a83d24e408c99cb711ae46257 Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-AttachVolumeTestJSON-1959880149 Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:40:23.399136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:40:23.401820 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c88935a83d24e408c99cb711ae46257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c88935a83d24e408c99cb711ae46257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c88935a83d24e408c99cb711ae46257"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c88935a83d24e408c99cb711ae46257"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:40:23.401820 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-AttachVolumeTestJSON-1959880149 Jun 21 18:40:23.401820 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 3c88935a83d24e408c99cb711ae46257 Jun 21 18:40:23.401820 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1959880149 Jun 21 18:40:23.401820 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-AttachVolumeTestJSON-1959880149-project Jun 21 18:40:23.401820 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:40:23.401820 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:40:23.401820 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: acf9a33e9fb941939010989a89a51d38 Jun 21 18:40:23.401820 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-AttachVolumeTestJSON-1959880149-project Jun 21 18:40:23.401820 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:40:23.401820 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 could not be found. Jun 21 18:40:23.401820 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': 'c42fc280-3e6d-4ac0-8b86-d7d69dc8f148'} Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 could not be found. Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:40:23.403688 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:40:23.406146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:40:23.406146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:40:23.406146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:40:23.406146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:40:23.406146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:40:23.406146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:40:23.406146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:40:23.406146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 could not be found. Jun 21 18:40:23.406146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:40:23.406146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:23.406146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:40:23.406146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:23.406146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:23.406146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:23.406146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:40:23.406146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:40:23.406146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 could not be found. Jun 21 18:40:23.406146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:40:23.408396 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e8ead374-4564-44f6-a3fc-96fc36a85728 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Returning 404 to user: Instance c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:40:23.408396 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e8ead374-4564-44f6-a3fc-96fc36a85728 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148" status: 404 len: 111 microversion: 2.1 time: 0.040092 Jun 21 18:40:23.408396 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 421/832] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:40:23 2022] GET /compute/v2.1/servers/c42fc280-3e6d-4ac0-8b86-d7d69dc8f148 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 18:40:23.632397 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-9b830262-d1e2-44a6-8184-689dc22250ff tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:23.633210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-9b830262-d1e2-44a6-8184-689dc22250ff tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:23.640628 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9b830262-d1e2-44a6-8184-689dc22250ff tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:23.641235 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9b830262-d1e2-44a6-8184-689dc22250ff tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:23.643000 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9b830262-d1e2-44a6-8184-689dc22250ff tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:23.643821 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9b830262-d1e2-44a6-8184-689dc22250ff tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:23.899908 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-9b830262-d1e2-44a6-8184-689dc22250ff tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:23.914669 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-9b830262-d1e2-44a6-8184-689dc22250ff tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:23.917797 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-9b830262-d1e2-44a6-8184-689dc22250ff tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:23.919843 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-9b830262-d1e2-44a6-8184-689dc22250ff tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1739 microversion: 2.20 time: 0.293878 Jun 21 18:40:23.923412 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 412/833] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:23 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1739 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:24.674514 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e610f2d6-8d61-44a1-8164-3e26410fc95c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:24.675451 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e610f2d6-8d61-44a1-8164-3e26410fc95c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:24.687448 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e610f2d6-8d61-44a1-8164-3e26410fc95c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:24.688897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e610f2d6-8d61-44a1-8164-3e26410fc95c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:24.689960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e610f2d6-8d61-44a1-8164-3e26410fc95c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:24.690650 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e610f2d6-8d61-44a1-8164-3e26410fc95c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:24.719271 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-e610f2d6-8d61-44a1-8164-3e26410fc95c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] HTTP exception thrown: Instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e could not be found. Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e610f2d6-8d61-44a1-8164-3e26410fc95c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Request method failure captured: Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: DELETE /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e HTTP/1.1 Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg4b5iP8NqvQaqLZMQOX17D08o8A7fg9Ot-ige1NWhVqvFHnDB3G6E_m1QKnYBakDyNPFWwu87nrNNsP8iUhNHwlm0pC00yNjpiKUa5c2iDV--laqn2ubVFlmaxemMBDeDKwfXSe867iALKtJnevww3w_urmBkmsubhnfWkrOl-c4ZI Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 3c88935a83d24e408c99cb711ae46257 Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-AttachVolumeTestJSON-1959880149 Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:40:24.723340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:40:24.725067 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c88935a83d24e408c99cb711ae46257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c88935a83d24e408c99cb711ae46257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c88935a83d24e408c99cb711ae46257"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c88935a83d24e408c99cb711ae46257"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:40:24.725067 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-AttachVolumeTestJSON-1959880149 Jun 21 18:40:24.725067 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 3c88935a83d24e408c99cb711ae46257 Jun 21 18:40:24.725067 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1959880149 Jun 21 18:40:24.725067 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-AttachVolumeTestJSON-1959880149-project Jun 21 18:40:24.725067 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:40:24.725067 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:40:24.725067 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: acf9a33e9fb941939010989a89a51d38 Jun 21 18:40:24.725067 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-AttachVolumeTestJSON-1959880149-project Jun 21 18:40:24.725067 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:40:24.725067 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e could not be found. Jun 21 18:40:24.725067 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': 'f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e'} Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e could not be found. Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:40:24.726024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e could not be found. Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e could not be found. Jun 21 18:40:24.731031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:40:24.733691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e610f2d6-8d61-44a1-8164-3e26410fc95c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Returning 404 to user: Instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:40:24.733691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e610f2d6-8d61-44a1-8164-3e26410fc95c tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "DELETE /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 404 len: 111 microversion: 2.1 time: 0.056465 Jun 21 18:40:24.733691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 422/834] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:40:24 2022] DELETE /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:40:24.737141 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e43a4b68-665e-4896-949a-0d92e0770e04 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:24.738422 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e43a4b68-665e-4896-949a-0d92e0770e04 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] [instance: f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:24.747632 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e43a4b68-665e-4896-949a-0d92e0770e04 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:24.751176 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e43a4b68-665e-4896-949a-0d92e0770e04 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:24.754054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e43a4b68-665e-4896-949a-0d92e0770e04 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:24.754527 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e43a4b68-665e-4896-949a-0d92e0770e04 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:24.784241 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-e43a4b68-665e-4896-949a-0d92e0770e04 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] HTTP exception thrown: Instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e could not be found. Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e43a4b68-665e-4896-949a-0d92e0770e04 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Request method failure captured: Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e HTTP/1.1 Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABisg4b5iP8NqvQaqLZMQOX17D08o8A7fg9Ot-ige1NWhVqvFHnDB3G6E_m1QKnYBakDyNPFWwu87nrNNsP8iUhNHwlm0pC00yNjpiKUa5c2iDV--laqn2ubVFlmaxemMBDeDKwfXSe867iALKtJnevww3w_urmBkmsubhnfWkrOl-c4ZI Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 3c88935a83d24e408c99cb711ae46257 Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-AttachVolumeTestJSON-1959880149 Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:40:24.785937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:40:24.795430 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c88935a83d24e408c99cb711ae46257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/3c88935a83d24e408c99cb711ae46257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/3c88935a83d24e408c99cb711ae46257"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_3c88935a83d24e408c99cb711ae46257"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:40:24.795430 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-AttachVolumeTestJSON-1959880149 Jun 21 18:40:24.795430 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 3c88935a83d24e408c99cb711ae46257 Jun 21 18:40:24.795430 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1959880149 Jun 21 18:40:24.795430 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-AttachVolumeTestJSON-1959880149-project Jun 21 18:40:24.795430 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:40:24.795430 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:40:24.795430 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: acf9a33e9fb941939010989a89a51d38 Jun 21 18:40:24.795430 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-AttachVolumeTestJSON-1959880149-project Jun 21 18:40:24.795430 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:40:24.795430 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e could not be found. Jun 21 18:40:24.795430 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': 'f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e'} Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e could not be found. Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:40:24.798073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:40:24.800670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:40:24.800670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:40:24.800670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:40:24.800670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:40:24.800670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:40:24.800670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:40:24.800670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:40:24.800670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e could not be found. Jun 21 18:40:24.800670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:24.800670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:24.800670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:24.800670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:24.800670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:24.800670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:24.800670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:40:24.800670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:40:24.800670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e could not be found. Jun 21 18:40:24.800670 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:24.805929 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e43a4b68-665e-4896-949a-0d92e0770e04 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] Returning 404 to user: Instance f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:40:24.805929 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e43a4b68-665e-4896-949a-0d92e0770e04 tempest-AttachVolumeTestJSON-1959880149 tempest-AttachVolumeTestJSON-1959880149-project] 10.222.0.87 "GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e" status: 404 len: 111 microversion: 2.1 time: 0.055303 Jun 21 18:40:24.805929 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 413/835] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:40:24 2022] GET /compute/v2.1/servers/f48cd40b-2f2d-4e82-8a6c-2f72b8910e0e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:40:24.956913 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-d6fcaf48-ce04-4c03-9ec3-bd720f5acc28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:24.958974 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-d6fcaf48-ce04-4c03-9ec3-bd720f5acc28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:24.969595 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d6fcaf48-ce04-4c03-9ec3-bd720f5acc28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:24.970637 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d6fcaf48-ce04-4c03-9ec3-bd720f5acc28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:24.971699 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d6fcaf48-ce04-4c03-9ec3-bd720f5acc28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:24.972464 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d6fcaf48-ce04-4c03-9ec3-bd720f5acc28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:25.235438 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-d6fcaf48-ce04-4c03-9ec3-bd720f5acc28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:25.253154 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-d6fcaf48-ce04-4c03-9ec3-bd720f5acc28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:25.257109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-d6fcaf48-ce04-4c03-9ec3-bd720f5acc28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:25.260307 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-d6fcaf48-ce04-4c03-9ec3-bd720f5acc28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1739 microversion: 2.20 time: 0.311884 Jun 21 18:40:25.262011 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 423/836] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:24 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1739 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:26.288294 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d4ba6423-13e2-4c62-a93e-42d397247593 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:26.289071 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-d4ba6423-13e2-4c62-a93e-42d397247593 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:26.299576 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d4ba6423-13e2-4c62-a93e-42d397247593 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:26.300503 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d4ba6423-13e2-4c62-a93e-42d397247593 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:26.303731 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d4ba6423-13e2-4c62-a93e-42d397247593 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:26.304778 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d4ba6423-13e2-4c62-a93e-42d397247593 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:26.490994 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-d4ba6423-13e2-4c62-a93e-42d397247593 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:26.505214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-d4ba6423-13e2-4c62-a93e-42d397247593 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:26.508204 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-d4ba6423-13e2-4c62-a93e-42d397247593 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:26.509605 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-d4ba6423-13e2-4c62-a93e-42d397247593 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1739 microversion: 2.20 time: 0.226860 Jun 21 18:40:26.510385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 414/837] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:26 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:27.538416 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-cb95ea15-cde0-4d57-88be-4568833e9000 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:27.540346 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-cb95ea15-cde0-4d57-88be-4568833e9000 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:27.553603 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cb95ea15-cde0-4d57-88be-4568833e9000 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:27.554700 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cb95ea15-cde0-4d57-88be-4568833e9000 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:27.557699 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cb95ea15-cde0-4d57-88be-4568833e9000 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:27.558813 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cb95ea15-cde0-4d57-88be-4568833e9000 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:27.831217 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-cb95ea15-cde0-4d57-88be-4568833e9000 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:27.855190 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-cb95ea15-cde0-4d57-88be-4568833e9000 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:27.859232 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-cb95ea15-cde0-4d57-88be-4568833e9000 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:27.860619 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-cb95ea15-cde0-4d57-88be-4568833e9000 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1739 microversion: 2.20 time: 0.330118 Jun 21 18:40:27.862300 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 424/838] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:27 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1739 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:28.905180 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2d54acb6-4d7b-47f3-8a9d-f14de6da80cc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:28.906038 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-2d54acb6-4d7b-47f3-8a9d-f14de6da80cc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:28.919920 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2d54acb6-4d7b-47f3-8a9d-f14de6da80cc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:28.920382 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2d54acb6-4d7b-47f3-8a9d-f14de6da80cc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:28.921231 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2d54acb6-4d7b-47f3-8a9d-f14de6da80cc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:28.926130 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2d54acb6-4d7b-47f3-8a9d-f14de6da80cc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:29.165227 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2d54acb6-4d7b-47f3-8a9d-f14de6da80cc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:29.175497 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2d54acb6-4d7b-47f3-8a9d-f14de6da80cc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:29.177193 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2d54acb6-4d7b-47f3-8a9d-f14de6da80cc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:29.179405 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2d54acb6-4d7b-47f3-8a9d-f14de6da80cc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1739 microversion: 2.20 time: 0.281864 Jun 21 18:40:29.180410 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 415/839] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:28 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1739 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:30.211110 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e28f9426-84ae-4197-8834-dd03e331c1d3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:30.211941 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e28f9426-84ae-4197-8834-dd03e331c1d3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:30.235790 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e28f9426-84ae-4197-8834-dd03e331c1d3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:30.236261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e28f9426-84ae-4197-8834-dd03e331c1d3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:30.237257 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e28f9426-84ae-4197-8834-dd03e331c1d3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:30.237689 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e28f9426-84ae-4197-8834-dd03e331c1d3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:30.581069 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e28f9426-84ae-4197-8834-dd03e331c1d3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:30.616565 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e28f9426-84ae-4197-8834-dd03e331c1d3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:30.627028 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e28f9426-84ae-4197-8834-dd03e331c1d3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:30.629621 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e28f9426-84ae-4197-8834-dd03e331c1d3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1739 microversion: 2.20 time: 0.423733 Jun 21 18:40:30.655097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 425/840] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:30 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1739 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:40:31.665832 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-99adce05-80f5-49fc-97ec-20fb19338f25 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:31.668348 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-99adce05-80f5-49fc-97ec-20fb19338f25 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:31.681535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-99adce05-80f5-49fc-97ec-20fb19338f25 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:31.682614 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-99adce05-80f5-49fc-97ec-20fb19338f25 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:31.683966 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-99adce05-80f5-49fc-97ec-20fb19338f25 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:31.684964 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-99adce05-80f5-49fc-97ec-20fb19338f25 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:32.149421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-99adce05-80f5-49fc-97ec-20fb19338f25 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:32.184873 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-99adce05-80f5-49fc-97ec-20fb19338f25 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:32.190566 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-99adce05-80f5-49fc-97ec-20fb19338f25 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:32.193608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-99adce05-80f5-49fc-97ec-20fb19338f25 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1739 microversion: 2.20 time: 0.534740 Jun 21 18:40:32.204329 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 416/841] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:31 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1739 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:33.231184 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c839e9ed-a8bd-4749-860e-19f96be88199 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:33.232262 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c839e9ed-a8bd-4749-860e-19f96be88199 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:33.245059 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c839e9ed-a8bd-4749-860e-19f96be88199 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:33.246365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c839e9ed-a8bd-4749-860e-19f96be88199 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:33.248191 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c839e9ed-a8bd-4749-860e-19f96be88199 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:33.249231 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c839e9ed-a8bd-4749-860e-19f96be88199 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:33.411489 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c0a2b3a8-21ef-4c79-85a1-4d264ba3794d tempest-VolumesGetTestJSON-280046481 tempest-VolumesGetTestJSON-280046481-project] Action: 'create', calling method: .version_select at 0x7fd8b2ed8ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-880331888", "metadata": {"Type": "work"}}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:40:33.495632 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c839e9ed-a8bd-4749-860e-19f96be88199 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:33.509590 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c839e9ed-a8bd-4749-860e-19f96be88199 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:33.512584 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c839e9ed-a8bd-4749-860e-19f96be88199 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:33.515539 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c839e9ed-a8bd-4749-860e-19f96be88199 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1739 microversion: 2.20 time: 0.292118 Jun 21 18:40:33.517004 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 417/842] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:33 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1739 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:40:33.833323 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c0a2b3a8-21ef-4c79-85a1-4d264ba3794d tempest-VolumesGetTestJSON-280046481 tempest-VolumesGetTestJSON-280046481-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.674769 Jun 21 18:40:33.834447 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 426/843] 10.222.0.87 () {60 vars in 1155 bytes} [Tue Jun 21 18:40:33 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 677 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 21 18:40:33.850925 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-8b80f016-987a-454c-b141-5abf7a70d2ab tempest-VolumesGetTestJSON-280046481 tempest-VolumesGetTestJSON-280046481-project] Calling method '.version_select at 0x7fd8bb92cd30>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:33.919539 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-8b80f016-987a-454c-b141-5abf7a70d2ab tempest-VolumesGetTestJSON-280046481 tempest-VolumesGetTestJSON-280046481-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/8166036a-9b9d-4cf8-bac4-36fc29f681bd" status: 200 len: 352 microversion: 2.1 time: 0.075504 Jun 21 18:40:33.920597 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 418/844] 10.222.0.87 () {58 vars in 1244 bytes} [Tue Jun 21 18:40:33 2022] GET /compute/v2.1/os-volumes/8166036a-9b9d-4cf8-bac4-36fc29f681bd => generated 352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:40:34.547481 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2b414bbe-3ebd-419d-b983-893630d23844 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:34.548634 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-2b414bbe-3ebd-419d-b983-893630d23844 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:34.559021 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2b414bbe-3ebd-419d-b983-893630d23844 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:34.559823 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2b414bbe-3ebd-419d-b983-893630d23844 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:34.561226 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2b414bbe-3ebd-419d-b983-893630d23844 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:34.562055 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2b414bbe-3ebd-419d-b983-893630d23844 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:34.752944 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2b414bbe-3ebd-419d-b983-893630d23844 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:34.767307 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2b414bbe-3ebd-419d-b983-893630d23844 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:34.769050 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2b414bbe-3ebd-419d-b983-893630d23844 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:34.770478 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-2b414bbe-3ebd-419d-b983-893630d23844 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1721 microversion: 2.20 time: 0.228601 Jun 21 18:40:34.771128 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 427/845] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:34 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:40:34.938213 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-8c25797c-bfc5-4bd0-bdd5-29073b000164 tempest-VolumesGetTestJSON-280046481 tempest-VolumesGetTestJSON-280046481-project] Calling method '.version_select at 0x7fd8bb8ba550>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:35.031244 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-8c25797c-bfc5-4bd0-bdd5-29073b000164 tempest-VolumesGetTestJSON-280046481 tempest-VolumesGetTestJSON-280046481-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/8166036a-9b9d-4cf8-bac4-36fc29f681bd" status: 200 len: 353 microversion: 2.1 time: 0.098035 Jun 21 18:40:35.032460 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 419/846] 10.222.0.87 () {58 vars in 1244 bytes} [Tue Jun 21 18:40:34 2022] GET /compute/v2.1/os-volumes/8166036a-9b9d-4cf8-bac4-36fc29f681bd => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:40:35.047390 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2625f25d-d103-4eed-95fd-a8f8c0d1f4d3 tempest-VolumesGetTestJSON-280046481 tempest-VolumesGetTestJSON-280046481-project] Calling method '.version_select at 0x7fd8b2ed84c0>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:35.111617 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-2625f25d-d103-4eed-95fd-a8f8c0d1f4d3 tempest-VolumesGetTestJSON-280046481 tempest-VolumesGetTestJSON-280046481-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/8166036a-9b9d-4cf8-bac4-36fc29f681bd" status: 200 len: 353 microversion: 2.1 time: 0.068913 Jun 21 18:40:35.113039 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 428/847] 10.222.0.87 () {58 vars in 1244 bytes} [Tue Jun 21 18:40:35 2022] GET /compute/v2.1/os-volumes/8166036a-9b9d-4cf8-bac4-36fc29f681bd => generated 353 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:40:35.128252 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-ea3b3e46-dd85-4f67-aa87-f83a4ae16a6b tempest-VolumesGetTestJSON-280046481 tempest-VolumesGetTestJSON-280046481-project] Calling method '.version_select at 0x7fd8bb922040>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:35.210647 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-ea3b3e46-dd85-4f67-aa87-f83a4ae16a6b tempest-VolumesGetTestJSON-280046481 tempest-VolumesGetTestJSON-280046481-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/8166036a-9b9d-4cf8-bac4-36fc29f681bd" status: 202 len: 0 microversion: 2.1 time: 0.087630 Jun 21 18:40:35.211308 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 420/848] 10.222.0.87 () {58 vars in 1247 bytes} [Tue Jun 21 18:40:35 2022] DELETE /compute/v2.1/os-volumes/8166036a-9b9d-4cf8-bac4-36fc29f681bd => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:40:35.221977 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a59250f8-426f-4e1d-a8d2-8195cc0fac04 tempest-VolumesGetTestJSON-280046481 tempest-VolumesGetTestJSON-280046481-project] Calling method '.version_select at 0x7fd8b802d550>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:35.285676 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-a59250f8-426f-4e1d-a8d2-8195cc0fac04 tempest-VolumesGetTestJSON-280046481 tempest-VolumesGetTestJSON-280046481-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/8166036a-9b9d-4cf8-bac4-36fc29f681bd" status: 200 len: 352 microversion: 2.1 time: 0.068794 Jun 21 18:40:35.286267 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 429/849] 10.222.0.87 () {58 vars in 1244 bytes} [Tue Jun 21 18:40:35 2022] GET /compute/v2.1/os-volumes/8166036a-9b9d-4cf8-bac4-36fc29f681bd => generated 352 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:40:35.790491 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-ff696d1e-32c6-4f27-b491-1d5500b26d55 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:35.791037 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-ff696d1e-32c6-4f27-b491-1d5500b26d55 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:35.797894 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ff696d1e-32c6-4f27-b491-1d5500b26d55 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:35.798442 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ff696d1e-32c6-4f27-b491-1d5500b26d55 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:35.799231 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ff696d1e-32c6-4f27-b491-1d5500b26d55 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:35.799667 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ff696d1e-32c6-4f27-b491-1d5500b26d55 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:36.005860 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ff696d1e-32c6-4f27-b491-1d5500b26d55 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:36.019604 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ff696d1e-32c6-4f27-b491-1d5500b26d55 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:36.021183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ff696d1e-32c6-4f27-b491-1d5500b26d55 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:36.022608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-ff696d1e-32c6-4f27-b491-1d5500b26d55 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1721 microversion: 2.20 time: 0.236701 Jun 21 18:40:36.023232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 421/850] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:35 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:36.300476 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2680ecdb-8be5-4065-91f9-a3f131db433b tempest-VolumesGetTestJSON-280046481 tempest-VolumesGetTestJSON-280046481-project] Calling method '.version_select at 0x7fd8b812f310>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:36.335802 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-2680ecdb-8be5-4065-91f9-a3f131db433b tempest-VolumesGetTestJSON-280046481 tempest-VolumesGetTestJSON-280046481-project] HTTP exception thrown: Volume 8166036a-9b9d-4cf8-bac4-36fc29f681bd could not be found. Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2680ecdb-8be5-4065-91f9-a3f131db433b tempest-VolumesGetTestJSON-280046481 tempest-VolumesGetTestJSON-280046481-project] Request method failure captured: Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: GET /compute/v2.1/os-volumes/8166036a-9b9d-4cf8-bac4-36fc29f681bd HTTP/1.1 Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABishChaFAXulbgeDrq98j0nVi4WES0e2iH5aj1QuVmLkhj4W1uV1zQtvzHMcF4u_R1FWA0Wz0W9c1DPsWI37Bnmf2L0m4cU_ia6iqyjE_btwSW5PnfxkLw8hrYggumcdfE-6WR1AsEGRSyP7VsPUjecNMptMH8hWsLDTIfHrYcKk5kTxQ Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: aa108438fb6d4660975eb3589e79d97c Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-VolumesGetTestJSON-280046481 Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:40:36.337895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:40:36.340204 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/aa108438fb6d4660975eb3589e79d97c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/aa108438fb6d4660975eb3589e79d97c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/aa108438fb6d4660975eb3589e79d97c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_aa108438fb6d4660975eb3589e79d97c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:40:36.340204 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-VolumesGetTestJSON-280046481 Jun 21 18:40:36.340204 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: aa108438fb6d4660975eb3589e79d97c Jun 21 18:40:36.340204 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-VolumesGetTestJSON-280046481 Jun 21 18:40:36.340204 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-VolumesGetTestJSON-280046481-project Jun 21 18:40:36.340204 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:40:36.340204 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:40:36.340204 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: ded133a0c82942409998864f5e589c6a Jun 21 18:40:36.340204 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-VolumesGetTestJSON-280046481-project Jun 21 18:40:36.340204 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: Jun 21 18:40:36.340204 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Volume 8166036a-9b9d-4cf8-bac4-36fc29f681bd could not be found. Jun 21 18:40:36.340204 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': '8166036a-9b9d-4cf8-bac4-36fc29f681bd'} Jun 21 18:40:36.340204 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:40:36.341545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:36.341545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:40:36.341545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:40:36.341545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 18:40:36.341545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 18:40:36.341545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 18:40:36.341545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 18:40:36.341545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:40:36.341545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:40:36.341545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:40:36.341545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:40:36.341545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:40:36.341545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:40:36.341545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:40:36.341545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:40:36.341545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8166036a-9b9d-4cf8-bac4-36fc29f681bd could not be found. (HTTP 404) (Request-ID: req-7c6cd478-67b1-47e3-956c-9385e476604f) Jun 21 18:40:36.341545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:40:36.341545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:36.341545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:40:36.343458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:36.343458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 18:40:36.343458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 18:40:36.343458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 18:40:36.343458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 18:40:36.343458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 18:40:36.343458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 18:40:36.343458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 18:40:36.343458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 18:40:36.343458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:40:36.343458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:40:36.343458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 18:40:36.343458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 18:40:36.343458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 18:40:36.343458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 18:40:36.343458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:40:36.343458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:40:36.343458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:40:36.343458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:40:36.345517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:40:36.345517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:40:36.345517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:40:36.345517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:40:36.345517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8166036a-9b9d-4cf8-bac4-36fc29f681bd could not be found. Jun 21 18:40:36.345517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:40:36.345517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:36.345517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:40:36.345517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:36.345517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:36.345517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:36.345517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:40:36.345517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:40:36.345517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:40:36.345517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:40:36.345517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:40:36.345517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:40:36.345517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 18:40:36.345517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:40:36.347403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8166036a-9b9d-4cf8-bac4-36fc29f681bd could not be found. Jun 21 18:40:36.347403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:40:36.347403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:36.347403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:40:36.347403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:36.347403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:36.347403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:36.347403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:40:36.347403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:40:36.347403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8166036a-9b9d-4cf8-bac4-36fc29f681bd could not be found. Jun 21 18:40:36.347403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:40:36.347403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2680ecdb-8be5-4065-91f9-a3f131db433b tempest-VolumesGetTestJSON-280046481 tempest-VolumesGetTestJSON-280046481-project] Returning 404 to user: Volume 8166036a-9b9d-4cf8-bac4-36fc29f681bd could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:40:36.347403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-2680ecdb-8be5-4065-91f9-a3f131db433b tempest-VolumesGetTestJSON-280046481 tempest-VolumesGetTestJSON-280046481-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/8166036a-9b9d-4cf8-bac4-36fc29f681bd" status: 404 len: 109 microversion: 2.1 time: 0.044374 Jun 21 18:40:36.347403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 430/851] 10.222.0.87 () {58 vars in 1244 bytes} [Tue Jun 21 18:40:36 2022] GET /compute/v2.1/os-volumes/8166036a-9b9d-4cf8-bac4-36fc29f681bd => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:40:37.046864 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-230d4acd-4356-44bf-98b0-3fa9a42f25cb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:37.048758 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-230d4acd-4356-44bf-98b0-3fa9a42f25cb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:37.062307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-230d4acd-4356-44bf-98b0-3fa9a42f25cb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:37.063709 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-230d4acd-4356-44bf-98b0-3fa9a42f25cb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:37.065246 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-230d4acd-4356-44bf-98b0-3fa9a42f25cb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:37.066185 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-230d4acd-4356-44bf-98b0-3fa9a42f25cb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:37.310697 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-230d4acd-4356-44bf-98b0-3fa9a42f25cb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:37.326239 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-230d4acd-4356-44bf-98b0-3fa9a42f25cb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:37.329437 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-230d4acd-4356-44bf-98b0-3fa9a42f25cb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:37.331924 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-230d4acd-4356-44bf-98b0-3fa9a42f25cb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1724 microversion: 2.20 time: 0.293252 Jun 21 18:40:37.333095 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 422/852] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:37 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:37.362970 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f6de44dd-5730-4d69-95fc-d3e97940e039 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dad2d0ec-13cd-4d91-a19f-3bbd6fdebcfb"}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:40:37.365260 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f6de44dd-5730-4d69-95fc-d3e97940e039 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:37.377350 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f6de44dd-5730-4d69-95fc-d3e97940e039 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:37.378707 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f6de44dd-5730-4d69-95fc-d3e97940e039 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:37.382037 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f6de44dd-5730-4d69-95fc-d3e97940e039 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:37.383148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f6de44dd-5730-4d69-95fc-d3e97940e039 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:37.872667 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f6de44dd-5730-4d69-95fc-d3e97940e039 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "POST /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.518485 Jun 21 18:40:37.874524 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 431/853] 10.222.0.87 () {62 vars in 1363 bytes} [Tue Jun 21 18:40:37 2022] POST /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/os-volume_attachments => generated 188 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 18:40:37.884595 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-6cca0c9d-ec4f-4377-8a74-018a342a0236 req-a1acb240-037d-46e7-b7f6-e2bdb7a779f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aab1542-b7fd-4057-9da2-8bcef1265883", "name": "network-vif-unplugged", "status": "completed", "tag": "c320e6d5-945e-46d1-b2a9-bf683bd75477"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:40:37.908874 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-6cca0c9d-ec4f-4377-8a74-018a342a0236 req-a1acb240-037d-46e7-b7f6-e2bdb7a779f5 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:37.909896 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-6cca0c9d-ec4f-4377-8a74-018a342a0236 req-a1acb240-037d-46e7-b7f6-e2bdb7a779f5 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:37.933213 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.compute.server_external_events [req-6cca0c9d-ec4f-4377-8a74-018a342a0236 req-a1acb240-037d-46e7-b7f6-e2bdb7a779f5 service nova] Unable to find a host for instance 4aab1542-b7fd-4057-9da2-8bcef1265883. Dropping event network-vif-unplugged {{(pid=118108) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 21 18:40:37.935111 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-6cca0c9d-ec4f-4377-8a74-018a342a0236 req-a1acb240-037d-46e7-b7f6-e2bdb7a779f5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.069000 Jun 21 18:40:37.936257 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 423/854] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 71 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 21 18:40:38.071282 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-740291a0-b8b5-403b-bb86-f49a9dd23da4 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:40:38.072006 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-740291a0-b8b5-403b-bb86-f49a9dd23da4 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:38.082410 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-740291a0-b8b5-403b-bb86-f49a9dd23da4 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:38.083167 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-740291a0-b8b5-403b-bb86-f49a9dd23da4 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:38.084906 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-740291a0-b8b5-403b-bb86-f49a9dd23da4 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:38.085768 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-740291a0-b8b5-403b-bb86-f49a9dd23da4 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:38.114357 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:40:38.234093 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR oslo.messaging._drivers.impl_rabbit [None req-740291a0-b8b5-403b-bb86-f49a9dd23da4 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [773a14aa-5380-461a-9260-4bd300a039e6] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 21 18:40:38.647510 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-aeaa3e23-95e1-4996-89e7-607c171e291d tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] Action: 'create', calling method: .version_select at 0x7fd8bb922ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1598334677", "metadata": {"Type": "work"}}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-aeaa3e23-95e1-4996-89e7-607c171e291d tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] Request method failure captured: Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 122 Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABishCmPlFmaID47ywSYRuK42DPb5Ms2fd9oydv8XKwboPpy9jYZE6CuGP9ng-HQ_JDxJbrlVyO-GzFz9w5WL-Mh1sStMJ4GywbtJwMEc3M2E7rMKOYJ2jLTTWvSpXz8EfN02UHoQSln6hssZtMyt_rFGTN13sCOZiTgGXDWMBJtAODb58 Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 891e26050f10474b9f70bc46d5b1975d Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-VolumesNegativeTest-291347808 Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:40:38.714750 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:40:38.716658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:40:38.716658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-VolumesNegativeTest-291347808 Jun 21 18:40:38.716658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 891e26050f10474b9f70bc46d5b1975d Jun 21 18:40:38.716658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-VolumesNegativeTest-291347808 Jun 21 18:40:38.716658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-VolumesNegativeTest-291347808-project Jun 21 18:40:38.716658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:40:38.716658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:40:38.716658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 187d5f81ce704deab74fb20bbe23bb0d Jun 21 18:40:38.716658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-VolumesNegativeTest-291347808-project Jun 21 18:40:38.716658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Jun 21 18:40:38.716658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1598334677", "metadata": {"Type": "work"}}} Jun 21 18:40:38.716658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: Jun 21 18:40:38.716658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1598334677', 'metadata': {'Type': 'work'}}}} Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise error Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi '#$%' Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:40:38.717624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:40:38.719174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:40:38.719174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:40:38.719174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:40:38.719174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:40:38.719174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 18:40:38.719174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 18:40:38.719174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 18:40:38.719174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 18:40:38.719174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 18:40:38.719174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 18:40:38.719174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 18:40:38.719174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.719174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:38.719174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.719174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.719174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:38.719174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:38.719174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 18:40:38.719174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 18:40:38.720600 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 18:40:38.720600 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.720600 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-aeaa3e23-95e1-4996-89e7-607c171e291d tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:40:38.720600 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-aeaa3e23-95e1-4996-89e7-607c171e291d tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.230526 Jun 21 18:40:38.720600 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 424/855] 10.222.0.87 () {60 vars in 1155 bytes} [Tue Jun 21 18:40:38 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 233 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 18:40:38.730278 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2131ec5d-bded-46f4-8920-d1a295d09b8e tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] Action: 'create', calling method: .version_select at 0x7fd8bb8ba9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-595640504", "metadata": {"Type": "work"}}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2131ec5d-bded-46f4-8920-d1a295d09b8e tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] Request method failure captured: Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 119 Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABishCmPlFmaID47ywSYRuK42DPb5Ms2fd9oydv8XKwboPpy9jYZE6CuGP9ng-HQ_JDxJbrlVyO-GzFz9w5WL-Mh1sStMJ4GywbtJwMEc3M2E7rMKOYJ2jLTTWvSpXz8EfN02UHoQSln6hssZtMyt_rFGTN13sCOZiTgGXDWMBJtAODb58 Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 891e26050f10474b9f70bc46d5b1975d Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-VolumesNegativeTest-291347808 Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:40:38.733582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:40:38.736212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:40:38.736212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-VolumesNegativeTest-291347808 Jun 21 18:40:38.736212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 891e26050f10474b9f70bc46d5b1975d Jun 21 18:40:38.736212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-VolumesNegativeTest-291347808 Jun 21 18:40:38.736212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-VolumesNegativeTest-291347808-project Jun 21 18:40:38.736212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:40:38.736212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:40:38.736212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 187d5f81ce704deab74fb20bbe23bb0d Jun 21 18:40:38.736212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-VolumesNegativeTest-291347808-project Jun 21 18:40:38.736212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Jun 21 18:40:38.736212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-595640504", "metadata": {"Type": "work"}}} Jun 21 18:40:38.736212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: Jun 21 18:40:38.736212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-595640504', 'metadata': {'Type': 'work'}}}} Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise error Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi '0' Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:40:38.737785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:40:38.740609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:40:38.740609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:40:38.740609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:40:38.740609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:40:38.740609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 18:40:38.740609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 18:40:38.740609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 18:40:38.740609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 18:40:38.740609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 18:40:38.740609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 18:40:38.740609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 18:40:38.740609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.740609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:38.740609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.740609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.740609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:38.740609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:38.740609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 18:40:38.740609 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 18:40:38.743175 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 18:40:38.743175 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.743175 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2131ec5d-bded-46f4-8920-d1a295d09b8e tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:40:38.743175 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2131ec5d-bded-46f4-8920-d1a295d09b8e tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009318 Jun 21 18:40:38.743175 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 425/856] 10.222.0.87 () {60 vars in 1155 bytes} [Tue Jun 21 18:40:38 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 18:40:38.749493 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d419ed27-b709-480d-8670-350d4d1c54d2 tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] Action: 'create', calling method: .version_select at 0x7fd8b2eea310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-437940816", "metadata": {"Type": "work"}}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d419ed27-b709-480d-8670-350d4d1c54d2 tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] Request method failure captured: Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 118 Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABishCmPlFmaID47ywSYRuK42DPb5Ms2fd9oydv8XKwboPpy9jYZE6CuGP9ng-HQ_JDxJbrlVyO-GzFz9w5WL-Mh1sStMJ4GywbtJwMEc3M2E7rMKOYJ2jLTTWvSpXz8EfN02UHoQSln6hssZtMyt_rFGTN13sCOZiTgGXDWMBJtAODb58 Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 891e26050f10474b9f70bc46d5b1975d Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-VolumesNegativeTest-291347808 Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:40:38.752017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:40:38.754521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:40:38.754521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-VolumesNegativeTest-291347808 Jun 21 18:40:38.754521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 891e26050f10474b9f70bc46d5b1975d Jun 21 18:40:38.754521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-VolumesNegativeTest-291347808 Jun 21 18:40:38.754521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-VolumesNegativeTest-291347808-project Jun 21 18:40:38.754521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:40:38.754521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:40:38.754521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 187d5f81ce704deab74fb20bbe23bb0d Jun 21 18:40:38.754521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-VolumesNegativeTest-291347808-project Jun 21 18:40:38.754521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Jun 21 18:40:38.754521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-437940816", "metadata": {"Type": "work"}}} Jun 21 18:40:38.754521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: Jun 21 18:40:38.754521 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-437940816', 'metadata': {'Type': 'work'}}}} Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise error Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi '' Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:40:38.755890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:40:38.758421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:40:38.758421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:40:38.758421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:40:38.758421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:40:38.758421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 18:40:38.758421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 18:40:38.758421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 18:40:38.758421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 18:40:38.758421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 18:40:38.758421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 18:40:38.758421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 18:40:38.758421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.758421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:38.758421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.758421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.758421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:38.758421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:38.758421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 18:40:38.758421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 18:40:38.760547 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 18:40:38.760547 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.760547 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d419ed27-b709-480d-8670-350d4d1c54d2 tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:40:38.760547 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-d419ed27-b709-480d-8670-350d4d1c54d2 tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] 10.222.0.87 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008097 Jun 21 18:40:38.760547 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 426/857] 10.222.0.87 () {60 vars in 1155 bytes} [Tue Jun 21 18:40:38 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 21 18:40:38.765973 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-135251ec-df4a-4bcd-906d-c68c853f44e4 tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] Calling method '.version_select at 0x7fd8b2eed040>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:38.798473 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-135251ec-df4a-4bcd-906d-c68c853f44e4 tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] HTTP exception thrown: Volume tempest-invalid-640889441 could not be found. Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-135251ec-df4a-4bcd-906d-c68c853f44e4 tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] Request method failure captured: Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-640889441 HTTP/1.1 Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABishCmPlFmaID47ywSYRuK42DPb5Ms2fd9oydv8XKwboPpy9jYZE6CuGP9ng-HQ_JDxJbrlVyO-GzFz9w5WL-Mh1sStMJ4GywbtJwMEc3M2E7rMKOYJ2jLTTWvSpXz8EfN02UHoQSln6hssZtMyt_rFGTN13sCOZiTgGXDWMBJtAODb58 Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 891e26050f10474b9f70bc46d5b1975d Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-VolumesNegativeTest-291347808 Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:40:38.800587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:40:38.802741 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:40:38.802741 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-VolumesNegativeTest-291347808 Jun 21 18:40:38.802741 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 891e26050f10474b9f70bc46d5b1975d Jun 21 18:40:38.802741 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-VolumesNegativeTest-291347808 Jun 21 18:40:38.802741 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-VolumesNegativeTest-291347808-project Jun 21 18:40:38.802741 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:40:38.802741 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:40:38.802741 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 187d5f81ce704deab74fb20bbe23bb0d Jun 21 18:40:38.802741 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-VolumesNegativeTest-291347808-project Jun 21 18:40:38.802741 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: Jun 21 18:40:38.802741 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Volume tempest-invalid-640889441 could not be found. Jun 21 18:40:38.802741 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': 'tempest-invalid-640889441'} Jun 21 18:40:38.802741 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:40:38.804232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.804232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:40:38.804232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:40:38.804232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 18:40:38.804232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 18:40:38.804232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 18:40:38.804232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 18:40:38.804232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 18:40:38.804232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 18:40:38.804232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 18:40:38.804232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 18:40:38.804232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:40:38.804232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:40:38.804232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:40:38.804232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:40:38.804232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-640889441 could not be found. (HTTP 404) (Request-ID: req-9a9ad03d-016a-4457-8658-13ef8dc4b195) Jun 21 18:40:38.804232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.804232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:38.804232 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.806721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.806721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 18:40:38.806721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 18:40:38.806721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 18:40:38.806721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 18:40:38.806721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 18:40:38.806721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 18:40:38.806721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 18:40:38.806721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 18:40:38.806721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:40:38.806721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:40:38.806721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 18:40:38.806721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 18:40:38.806721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 18:40:38.806721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 18:40:38.806721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 18:40:38.806721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 18:40:38.806721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 18:40:38.806721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-640889441 could not be found. Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:40:38.809300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-640889441 could not be found. Jun 21 18:40:38.811703 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.811703 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:38.811703 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.811703 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.811703 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:38.811703 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:38.811703 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:40:38.811703 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:40:38.811703 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-640889441 could not be found. Jun 21 18:40:38.811703 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.811703 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-135251ec-df4a-4bcd-906d-c68c853f44e4 tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] Returning 404 to user: Volume tempest-invalid-640889441 could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:40:38.811703 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-135251ec-df4a-4bcd-906d-c68c853f44e4 tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/tempest-invalid-640889441" status: 404 len: 98 microversion: 2.1 time: 0.040086 Jun 21 18:40:38.811703 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 427/858] 10.222.0.87 () {58 vars in 1214 bytes} [Tue Jun 21 18:40:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-640889441 => generated 98 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 21 18:40:38.815889 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-105bf720-ebb2-4dd2-b38e-b29a3aa4e9d8 tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004458 Jun 21 18:40:38.816400 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 428/859] 10.222.0.87 () {58 vars in 1139 bytes} [Tue Jun 21 18:40:38 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 21 18:40:38.827634 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-0b106028-33d2-486f-883f-60b3b1d51994 tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004529 Jun 21 18:40:38.828517 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 429/860] 10.222.0.87 () {58 vars in 1136 bytes} [Tue Jun 21 18:40:38 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 21 18:40:38.840320 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e6d78ce4-e12d-4156-828e-de4ce370b5ac tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] Calling method '.version_select at 0x7fd8b2eeac10>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:38.872499 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-e6d78ce4-e12d-4156-828e-de4ce370b5ac tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] HTTP exception thrown: Volume dae55367-f789-45ea-acea-baabe1cb51de could not be found. Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e6d78ce4-e12d-4156-828e-de4ce370b5ac tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] Request method failure captured: Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: DELETE /compute/v2.1/os-volumes/dae55367-f789-45ea-acea-baabe1cb51de HTTP/1.1 Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABishCmPlFmaID47ywSYRuK42DPb5Ms2fd9oydv8XKwboPpy9jYZE6CuGP9ng-HQ_JDxJbrlVyO-GzFz9w5WL-Mh1sStMJ4GywbtJwMEc3M2E7rMKOYJ2jLTTWvSpXz8EfN02UHoQSln6hssZtMyt_rFGTN13sCOZiTgGXDWMBJtAODb58 Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 891e26050f10474b9f70bc46d5b1975d Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-VolumesNegativeTest-291347808 Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:40:38.877110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:40:38.878857 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:40:38.878857 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-VolumesNegativeTest-291347808 Jun 21 18:40:38.878857 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 891e26050f10474b9f70bc46d5b1975d Jun 21 18:40:38.878857 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-VolumesNegativeTest-291347808 Jun 21 18:40:38.878857 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-VolumesNegativeTest-291347808-project Jun 21 18:40:38.878857 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:40:38.878857 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:40:38.878857 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 187d5f81ce704deab74fb20bbe23bb0d Jun 21 18:40:38.878857 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-VolumesNegativeTest-291347808-project Jun 21 18:40:38.878857 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: Jun 21 18:40:38.878857 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Volume dae55367-f789-45ea-acea-baabe1cb51de could not be found. Jun 21 18:40:38.878857 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': 'dae55367-f789-45ea-acea-baabe1cb51de'} Jun 21 18:40:38.878857 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:40:38.879838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.879838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:40:38.879838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:40:38.879838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 18:40:38.879838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 18:40:38.879838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 18:40:38.879838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 18:40:38.879838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 18:40:38.879838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 18:40:38.879838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 18:40:38.879838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 18:40:38.879838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:40:38.879838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:40:38.879838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:40:38.879838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:40:38.879838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dae55367-f789-45ea-acea-baabe1cb51de could not be found. (HTTP 404) (Request-ID: req-cccc87b9-cd16-4098-98f9-95c3cedfc087) Jun 21 18:40:38.879838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.879838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:38.879838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.881158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.881158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 18:40:38.881158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 18:40:38.881158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 18:40:38.881158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 18:40:38.881158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 18:40:38.881158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 18:40:38.881158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 18:40:38.881158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 18:40:38.881158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:40:38.881158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:40:38.881158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 18:40:38.881158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 18:40:38.881158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 18:40:38.881158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 18:40:38.881158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 18:40:38.881158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 18:40:38.881158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 18:40:38.881158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 18:40:38.882307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:40:38.882307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:40:38.882307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:40:38.882307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:40:38.882307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dae55367-f789-45ea-acea-baabe1cb51de could not be found. Jun 21 18:40:38.882307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.882307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:38.882307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.882307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.882307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:38.882307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:38.882307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:40:38.882307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:40:38.882307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:40:38.882307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:40:38.882307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:40:38.882307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:40:38.882307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 18:40:38.882307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:40:38.883658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dae55367-f789-45ea-acea-baabe1cb51de could not be found. Jun 21 18:40:38.883658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.883658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:38.883658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.883658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.883658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:38.883658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:38.883658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:40:38.883658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:40:38.883658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dae55367-f789-45ea-acea-baabe1cb51de could not be found. Jun 21 18:40:38.883658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.883658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e6d78ce4-e12d-4156-828e-de4ce370b5ac tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] Returning 404 to user: Volume dae55367-f789-45ea-acea-baabe1cb51de could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:40:38.883658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e6d78ce4-e12d-4156-828e-de4ce370b5ac tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] 10.222.0.87 "DELETE /compute/v2.1/os-volumes/dae55367-f789-45ea-acea-baabe1cb51de" status: 404 len: 109 microversion: 2.1 time: 0.043315 Jun 21 18:40:38.883658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 430/861] 10.222.0.87 () {58 vars in 1247 bytes} [Tue Jun 21 18:40:38 2022] DELETE /compute/v2.1/os-volumes/dae55367-f789-45ea-acea-baabe1cb51de => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 18:40:38.895759 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2793253f-a1c5-4d39-9a90-8b104478a1e9 tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] Calling method '.version_select at 0x7fd8b2eea160>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:38.926115 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-2793253f-a1c5-4d39-9a90-8b104478a1e9 tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] HTTP exception thrown: Volume a7aab888-2c33-4e7a-aa20-1347d9b3c071 could not be found. Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2793253f-a1c5-4d39-9a90-8b104478a1e9 tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] Request method failure captured: Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/os-volumes/a7aab888-2c33-4e7a-aa20-1347d9b3c071 HTTP/1.1 Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABishCmPlFmaID47ywSYRuK42DPb5Ms2fd9oydv8XKwboPpy9jYZE6CuGP9ng-HQ_JDxJbrlVyO-GzFz9w5WL-Mh1sStMJ4GywbtJwMEc3M2E7rMKOYJ2jLTTWvSpXz8EfN02UHoQSln6hssZtMyt_rFGTN13sCOZiTgGXDWMBJtAODb58 Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 891e26050f10474b9f70bc46d5b1975d Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-VolumesNegativeTest-291347808 Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:40:38.928107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:40:38.930532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_891e26050f10474b9f70bc46d5b1975d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:40:38.930532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-VolumesNegativeTest-291347808 Jun 21 18:40:38.930532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 891e26050f10474b9f70bc46d5b1975d Jun 21 18:40:38.930532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-VolumesNegativeTest-291347808 Jun 21 18:40:38.930532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-VolumesNegativeTest-291347808-project Jun 21 18:40:38.930532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:40:38.930532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:40:38.930532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 187d5f81ce704deab74fb20bbe23bb0d Jun 21 18:40:38.930532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-VolumesNegativeTest-291347808-project Jun 21 18:40:38.930532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: Jun 21 18:40:38.930532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Volume a7aab888-2c33-4e7a-aa20-1347d9b3c071 could not be found. Jun 21 18:40:38.930532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': 'a7aab888-2c33-4e7a-aa20-1347d9b3c071'} Jun 21 18:40:38.930532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:40:38.932043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.932043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:40:38.932043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:40:38.932043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 18:40:38.932043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 18:40:38.932043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 18:40:38.932043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 18:40:38.932043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:40:38.932043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:40:38.932043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:40:38.932043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:40:38.932043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:40:38.932043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:40:38.932043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:40:38.932043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:40:38.932043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a7aab888-2c33-4e7a-aa20-1347d9b3c071 could not be found. (HTTP 404) (Request-ID: req-18b0f0fc-c699-4300-b43f-3c5a8268dfb4) Jun 21 18:40:38.932043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.932043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:38.932043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.934159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.934159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 18:40:38.934159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 18:40:38.934159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 18:40:38.934159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 18:40:38.934159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 18:40:38.934159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 18:40:38.934159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 18:40:38.934159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 18:40:38.934159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 18:40:38.934159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 18:40:38.934159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 18:40:38.934159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 18:40:38.934159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 18:40:38.934159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 18:40:38.934159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 18:40:38.934159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 18:40:38.934159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 18:40:38.934159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 18:40:38.936234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 18:40:38.936234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 18:40:38.936234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 18:40:38.936234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 18:40:38.936234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a7aab888-2c33-4e7a-aa20-1347d9b3c071 could not be found. Jun 21 18:40:38.936234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.936234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:38.936234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.936234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.936234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:38.936234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:38.936234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:40:38.936234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:40:38.936234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 18:40:38.936234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 18:40:38.936234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:40:38.936234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:40:38.936234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 18:40:38.936234 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:40:38.938281 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a7aab888-2c33-4e7a-aa20-1347d9b3c071 could not be found. Jun 21 18:40:38.938281 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.938281 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:40:38.938281 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.938281 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:40:38.938281 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:40:38.938281 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:40:38.938281 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:40:38.938281 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:40:38.938281 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a7aab888-2c33-4e7a-aa20-1347d9b3c071 could not be found. Jun 21 18:40:38.938281 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:40:38.938281 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2793253f-a1c5-4d39-9a90-8b104478a1e9 tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] Returning 404 to user: Volume a7aab888-2c33-4e7a-aa20-1347d9b3c071 could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:40:38.938281 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2793253f-a1c5-4d39-9a90-8b104478a1e9 tempest-VolumesNegativeTest-291347808 tempest-VolumesNegativeTest-291347808-project] 10.222.0.87 "GET /compute/v2.1/os-volumes/a7aab888-2c33-4e7a-aa20-1347d9b3c071" status: 404 len: 109 microversion: 2.1 time: 0.040990 Jun 21 18:40:38.938281 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 431/862] 10.222.0.87 () {58 vars in 1244 bytes} [Tue Jun 21 18:40:38 2022] GET /compute/v2.1/os-volumes/a7aab888-2c33-4e7a-aa20-1347d9b3c071 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 18:40:39.246995 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO oslo.messaging._drivers.impl_rabbit [None req-740291a0-b8b5-403b-bb86-f49a9dd23da4 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [773a14aa-5380-461a-9260-4bd300a039e6] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 46442. Jun 21 18:40:39.254328 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-740291a0-b8b5-403b-bb86-f49a9dd23da4 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "POST /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/action" status: 202 len: 0 microversion: 2.20 time: 1.185819 Jun 21 18:40:39.255732 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 432/863] 10.222.0.87 () {62 vars in 1318 bytes} [Tue Jun 21 18:40:38 2022] POST /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/action => generated 0 bytes in 1190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:40:39.277133 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-8d08018f-309f-4139-950b-7ca9acef5197 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:39.278289 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-8d08018f-309f-4139-950b-7ca9acef5197 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:39.289790 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8d08018f-309f-4139-950b-7ca9acef5197 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:39.290562 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8d08018f-309f-4139-950b-7ca9acef5197 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:39.291980 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8d08018f-309f-4139-950b-7ca9acef5197 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:39.292793 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8d08018f-309f-4139-950b-7ca9acef5197 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:39.553688 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-8d08018f-309f-4139-950b-7ca9acef5197 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:39.563830 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-8d08018f-309f-4139-950b-7ca9acef5197 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:39.565454 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-8d08018f-309f-4139-950b-7ca9acef5197 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:39.566756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-8d08018f-309f-4139-950b-7ca9acef5197 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1750 microversion: 2.20 time: 0.301865 Jun 21 18:40:39.567564 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 432/864] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:39 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1750 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:40:40.598874 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1f0b7308-5988-4159-871c-6a1ec27d7933 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:40.600099 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1f0b7308-5988-4159-871c-6a1ec27d7933 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:40.613072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1f0b7308-5988-4159-871c-6a1ec27d7933 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:40.613942 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1f0b7308-5988-4159-871c-6a1ec27d7933 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:40.615361 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1f0b7308-5988-4159-871c-6a1ec27d7933 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:40.615848 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1f0b7308-5988-4159-871c-6a1ec27d7933 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:40.826742 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1f0b7308-5988-4159-871c-6a1ec27d7933 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:40.842339 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1f0b7308-5988-4159-871c-6a1ec27d7933 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:40.845856 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1f0b7308-5988-4159-871c-6a1ec27d7933 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:40.848156 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1f0b7308-5988-4159-871c-6a1ec27d7933 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1750 microversion: 2.20 time: 0.259216 Jun 21 18:40:40.849315 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 433/865] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:40 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1750 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:41.873587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-54b275c3-454d-491c-9a2a-f871cb968209 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:41.875065 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-54b275c3-454d-491c-9a2a-f871cb968209 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:41.885582 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-54b275c3-454d-491c-9a2a-f871cb968209 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:41.886159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-54b275c3-454d-491c-9a2a-f871cb968209 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:41.887187 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-54b275c3-454d-491c-9a2a-f871cb968209 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:41.887862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-54b275c3-454d-491c-9a2a-f871cb968209 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:42.115275 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-54b275c3-454d-491c-9a2a-f871cb968209 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:42.133948 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-54b275c3-454d-491c-9a2a-f871cb968209 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:42.137156 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-54b275c3-454d-491c-9a2a-f871cb968209 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:42.139703 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-54b275c3-454d-491c-9a2a-f871cb968209 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1750 microversion: 2.20 time: 0.271727 Jun 21 18:40:42.142571 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 433/866] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:41 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1750 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:40:42.411235 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f5587ab8-4064-4477-8dac-900f9136b978 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:42.411797 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f5587ab8-4064-4477-8dac-900f9136b978 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:42.418361 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f5587ab8-4064-4477-8dac-900f9136b978 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:42.418807 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f5587ab8-4064-4477-8dac-900f9136b978 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:42.419588 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f5587ab8-4064-4477-8dac-900f9136b978 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:42.420011 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f5587ab8-4064-4477-8dac-900f9136b978 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:42.448570 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f5587ab8-4064-4477-8dac-900f9136b978 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/ips" status: 200 len: 149 microversion: 2.1 time: 0.324907 Jun 21 18:40:42.449136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 434/867] 10.222.0.87 () {58 vars in 1247 bytes} [Tue Jun 21 18:40:42 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/ips => generated 149 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:40:43.165273 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-8ab2f293-227d-4c90-96f9-da146f16a408 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:43.166848 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-8ab2f293-227d-4c90-96f9-da146f16a408 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:43.177896 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8ab2f293-227d-4c90-96f9-da146f16a408 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:43.178730 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8ab2f293-227d-4c90-96f9-da146f16a408 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:43.179782 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8ab2f293-227d-4c90-96f9-da146f16a408 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:43.180412 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-8ab2f293-227d-4c90-96f9-da146f16a408 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:43.440721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-8ab2f293-227d-4c90-96f9-da146f16a408 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:43.452845 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-8ab2f293-227d-4c90-96f9-da146f16a408 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:43.455877 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-8ab2f293-227d-4c90-96f9-da146f16a408 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:43.457831 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-8ab2f293-227d-4c90-96f9-da146f16a408 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1750 microversion: 2.20 time: 0.300090 Jun 21 18:40:43.458751 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 434/868] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:43 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1750 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:43.914216 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6cdf7e67-bd57-4aa5-bf36-8fd470965ce9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fd34044-bf22-482b-86b6-dc2b082e4e78"}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:40:43.916393 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6cdf7e67-bd57-4aa5-bf36-8fd470965ce9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:43.928642 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6cdf7e67-bd57-4aa5-bf36-8fd470965ce9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:43.929527 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6cdf7e67-bd57-4aa5-bf36-8fd470965ce9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:43.932119 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6cdf7e67-bd57-4aa5-bf36-8fd470965ce9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:43.933096 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6cdf7e67-bd57-4aa5-bf36-8fd470965ce9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:44.332144 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6cdf7e67-bd57-4aa5-bf36-8fd470965ce9 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "POST /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426104 Jun 21 18:40:44.332807 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 435/869] 10.222.0.87 () {60 vars in 1322 bytes} [Tue Jun 21 18:40:43 2022] POST /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:40:44.482525 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-51cbae1f-aa92-4c3e-a672-e9b8876da669 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:44.484016 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-51cbae1f-aa92-4c3e-a672-e9b8876da669 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:44.494472 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-51cbae1f-aa92-4c3e-a672-e9b8876da669 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:44.495450 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-51cbae1f-aa92-4c3e-a672-e9b8876da669 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:44.496372 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-51cbae1f-aa92-4c3e-a672-e9b8876da669 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:44.497116 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-51cbae1f-aa92-4c3e-a672-e9b8876da669 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:44.528836 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=100 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:40:44.691546 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-51cbae1f-aa92-4c3e-a672-e9b8876da669 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:44.701799 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-51cbae1f-aa92-4c3e-a672-e9b8876da669 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:44.703766 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-51cbae1f-aa92-4c3e-a672-e9b8876da669 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:44.705141 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-51cbae1f-aa92-4c3e-a672-e9b8876da669 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1750 microversion: 2.20 time: 0.230951 Jun 21 18:40:44.705757 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 435/870] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:44 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1750 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:45.734532 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-143113be-2b2f-49f3-a1da-4f0d4bf3df1b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:45.735255 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-143113be-2b2f-49f3-a1da-4f0d4bf3df1b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:45.742987 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-143113be-2b2f-49f3-a1da-4f0d4bf3df1b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:45.743466 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-143113be-2b2f-49f3-a1da-4f0d4bf3df1b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:45.744222 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-143113be-2b2f-49f3-a1da-4f0d4bf3df1b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:45.744645 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-143113be-2b2f-49f3-a1da-4f0d4bf3df1b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:45.989109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-143113be-2b2f-49f3-a1da-4f0d4bf3df1b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:46.005672 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-143113be-2b2f-49f3-a1da-4f0d4bf3df1b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:46.008964 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-143113be-2b2f-49f3-a1da-4f0d4bf3df1b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:46.010895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-143113be-2b2f-49f3-a1da-4f0d4bf3df1b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1752 microversion: 2.20 time: 0.280823 Jun 21 18:40:46.011596 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 436/871] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:45 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1752 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:47.031625 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b206d968-0ead-462c-9903-52744b7deaa0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:47.032312 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b206d968-0ead-462c-9903-52744b7deaa0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:47.040701 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b206d968-0ead-462c-9903-52744b7deaa0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:47.041204 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b206d968-0ead-462c-9903-52744b7deaa0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:47.042228 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b206d968-0ead-462c-9903-52744b7deaa0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:47.043238 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b206d968-0ead-462c-9903-52744b7deaa0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:47.222395 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-b206d968-0ead-462c-9903-52744b7deaa0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:47.235329 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-b206d968-0ead-462c-9903-52744b7deaa0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:47.237285 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-b206d968-0ead-462c-9903-52744b7deaa0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:47.239014 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b206d968-0ead-462c-9903-52744b7deaa0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1752 microversion: 2.20 time: 0.212296 Jun 21 18:40:47.239727 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 436/872] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:47 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1752 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:48.272030 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b099992e-5e54-4a77-aadf-126ac9a28798 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:48.273045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b099992e-5e54-4a77-aadf-126ac9a28798 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:48.281926 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b099992e-5e54-4a77-aadf-126ac9a28798 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:48.282828 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b099992e-5e54-4a77-aadf-126ac9a28798 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:48.285229 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b099992e-5e54-4a77-aadf-126ac9a28798 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:48.286409 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b099992e-5e54-4a77-aadf-126ac9a28798 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:48.487419 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b099992e-5e54-4a77-aadf-126ac9a28798 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:48.500501 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b099992e-5e54-4a77-aadf-126ac9a28798 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:48.504433 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b099992e-5e54-4a77-aadf-126ac9a28798 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:48.506616 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b099992e-5e54-4a77-aadf-126ac9a28798 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1752 microversion: 2.20 time: 0.241136 Jun 21 18:40:48.508560 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 437/873] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:48 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1752 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:49.528328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e5153fc3-d936-418b-a6f2-6fe90d2e2357 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:49.528986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e5153fc3-d936-418b-a6f2-6fe90d2e2357 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:49.537689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e5153fc3-d936-418b-a6f2-6fe90d2e2357 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:49.538149 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e5153fc3-d936-418b-a6f2-6fe90d2e2357 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:49.538936 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e5153fc3-d936-418b-a6f2-6fe90d2e2357 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:49.539362 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e5153fc3-d936-418b-a6f2-6fe90d2e2357 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:49.694714 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e5153fc3-d936-418b-a6f2-6fe90d2e2357 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:49.704077 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e5153fc3-d936-418b-a6f2-6fe90d2e2357 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:49.705758 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e5153fc3-d936-418b-a6f2-6fe90d2e2357 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:49.706978 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e5153fc3-d936-418b-a6f2-6fe90d2e2357 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1752 microversion: 2.20 time: 0.182950 Jun 21 18:40:49.707550 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 437/874] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:49 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1752 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:50.728752 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ecc775a5-1e4b-40f7-ae93-6dfbf83e4938 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:50.729402 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ecc775a5-1e4b-40f7-ae93-6dfbf83e4938 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:50.737134 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ecc775a5-1e4b-40f7-ae93-6dfbf83e4938 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:50.737583 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ecc775a5-1e4b-40f7-ae93-6dfbf83e4938 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:50.738418 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ecc775a5-1e4b-40f7-ae93-6dfbf83e4938 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:50.739006 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ecc775a5-1e4b-40f7-ae93-6dfbf83e4938 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:50.902900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ecc775a5-1e4b-40f7-ae93-6dfbf83e4938 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:50.912003 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ecc775a5-1e4b-40f7-ae93-6dfbf83e4938 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:50.913505 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ecc775a5-1e4b-40f7-ae93-6dfbf83e4938 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:50.914719 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ecc775a5-1e4b-40f7-ae93-6dfbf83e4938 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1752 microversion: 2.20 time: 0.190259 Jun 21 18:40:50.915277 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 438/875] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:50 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1752 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:51.935714 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6cd76caa-ac29-4ac6-9029-40ef2548c429 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:51.937221 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-6cd76caa-ac29-4ac6-9029-40ef2548c429 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:51.943711 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=34 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:40:51.955470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6cd76caa-ac29-4ac6-9029-40ef2548c429 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:51.955842 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6cd76caa-ac29-4ac6-9029-40ef2548c429 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:51.958778 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6cd76caa-ac29-4ac6-9029-40ef2548c429 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:51.963566 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6cd76caa-ac29-4ac6-9029-40ef2548c429 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:52.172204 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6cd76caa-ac29-4ac6-9029-40ef2548c429 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:52.183072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a4218763-26e9-4a69-ab27-ac8e3d56ef8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:52.183728 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-a4218763-26e9-4a69-ab27-ac8e3d56ef8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:52.195446 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6cd76caa-ac29-4ac6-9029-40ef2548c429 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:52.197062 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6cd76caa-ac29-4ac6-9029-40ef2548c429 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:52.198531 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6cd76caa-ac29-4ac6-9029-40ef2548c429 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1752 microversion: 2.20 time: 0.267780 Jun 21 18:40:52.199139 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 438/876] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:51 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1752 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:52.202830 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a4218763-26e9-4a69-ab27-ac8e3d56ef8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:52.203312 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a4218763-26e9-4a69-ab27-ac8e3d56ef8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:52.204675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a4218763-26e9-4a69-ab27-ac8e3d56ef8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:52.205199 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a4218763-26e9-4a69-ab27-ac8e3d56ef8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:52.293837 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.objects.instance [None req-a4218763-26e9-4a69-ab27-ac8e3d56ef8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lazy-loading 'services' on Instance uuid 031fed05-1de1-49b6-8325-7a5ab4f19f1f {{(pid=118109) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:40:52.384124 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-a4218763-26e9-4a69-ab27-ac8e3d56ef8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "DELETE /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/os-volume_attachments/1fd34044-bf22-482b-86b6-dc2b082e4e78" status: 202 len: 0 microversion: 2.1 time: 0.205669 Jun 21 18:40:52.384950 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 439/877] 10.222.0.87 () {58 vars in 1415 bytes} [Tue Jun 21 18:40:52 2022] DELETE /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/os-volume_attachments/1fd34044-bf22-482b-86b6-dc2b082e4e78 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:40:52.401374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b62883e0-55db-4d20-a8d9-c0dc1b0b3cf2 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:52.403586 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b62883e0-55db-4d20-a8d9-c0dc1b0b3cf2 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:52.415527 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b62883e0-55db-4d20-a8d9-c0dc1b0b3cf2 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:52.416307 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b62883e0-55db-4d20-a8d9-c0dc1b0b3cf2 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:52.418577 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b62883e0-55db-4d20-a8d9-c0dc1b0b3cf2 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:52.419382 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b62883e0-55db-4d20-a8d9-c0dc1b0b3cf2 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:52.475197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b62883e0-55db-4d20-a8d9-c0dc1b0b3cf2 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082097 Jun 21 18:40:52.475872 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 439/878] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:40:52 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:40:53.223719 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-131f1151-f08a-44c9-b5bf-c10328f9c4c3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:53.224701 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-131f1151-f08a-44c9-b5bf-c10328f9c4c3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:53.232096 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-131f1151-f08a-44c9-b5bf-c10328f9c4c3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:53.232578 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-131f1151-f08a-44c9-b5bf-c10328f9c4c3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:53.233421 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-131f1151-f08a-44c9-b5bf-c10328f9c4c3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:53.233896 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-131f1151-f08a-44c9-b5bf-c10328f9c4c3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:53.391134 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-131f1151-f08a-44c9-b5bf-c10328f9c4c3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:53.401990 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-131f1151-f08a-44c9-b5bf-c10328f9c4c3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:53.403819 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-131f1151-f08a-44c9-b5bf-c10328f9c4c3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:53.405363 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-131f1151-f08a-44c9-b5bf-c10328f9c4c3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.188065 Jun 21 18:40:53.406049 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 440/879] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:53 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:53.489404 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e97d4f08-06cb-493b-9c62-f745c3513c3e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:53.490388 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e97d4f08-06cb-493b-9c62-f745c3513c3e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:53.497279 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e97d4f08-06cb-493b-9c62-f745c3513c3e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:53.497749 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e97d4f08-06cb-493b-9c62-f745c3513c3e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:53.498543 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e97d4f08-06cb-493b-9c62-f745c3513c3e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:53.498968 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e97d4f08-06cb-493b-9c62-f745c3513c3e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:53.532069 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e97d4f08-06cb-493b-9c62-f745c3513c3e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047257 Jun 21 18:40:53.532953 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 440/880] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:40:53 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:40:54.434234 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ea5412c9-0b8f-4cd7-9d6d-ee1634827d91 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:54.434985 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ea5412c9-0b8f-4cd7-9d6d-ee1634827d91 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:54.438091 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=34 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:40:54.444821 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ea5412c9-0b8f-4cd7-9d6d-ee1634827d91 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:54.445301 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ea5412c9-0b8f-4cd7-9d6d-ee1634827d91 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:54.446156 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ea5412c9-0b8f-4cd7-9d6d-ee1634827d91 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:54.446583 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ea5412c9-0b8f-4cd7-9d6d-ee1634827d91 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:54.544744 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-9dd5b040-2c3d-4828-9835-fee47e4dfeb4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:54.545717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-9dd5b040-2c3d-4828-9835-fee47e4dfeb4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:54.555236 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9dd5b040-2c3d-4828-9835-fee47e4dfeb4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:54.556149 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9dd5b040-2c3d-4828-9835-fee47e4dfeb4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:54.557539 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9dd5b040-2c3d-4828-9835-fee47e4dfeb4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:54.558396 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9dd5b040-2c3d-4828-9835-fee47e4dfeb4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:54.602792 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-9dd5b040-2c3d-4828-9835-fee47e4dfeb4 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061784 Jun 21 18:40:54.603335 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 441/881] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:40:54 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:40:54.610783 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ea5412c9-0b8f-4cd7-9d6d-ee1634827d91 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:54.626101 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ea5412c9-0b8f-4cd7-9d6d-ee1634827d91 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:54.628337 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ea5412c9-0b8f-4cd7-9d6d-ee1634827d91 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:54.629867 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ea5412c9-0b8f-4cd7-9d6d-ee1634827d91 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.202246 Jun 21 18:40:54.630653 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 441/882] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:54 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:55.618279 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-0a144b39-a9a7-446b-8ab9-4e0bcc0f4138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:55.619344 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-0a144b39-a9a7-446b-8ab9-4e0bcc0f4138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:55.626840 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0a144b39-a9a7-446b-8ab9-4e0bcc0f4138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:55.627337 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0a144b39-a9a7-446b-8ab9-4e0bcc0f4138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:55.628072 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0a144b39-a9a7-446b-8ab9-4e0bcc0f4138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:55.628504 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0a144b39-a9a7-446b-8ab9-4e0bcc0f4138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:55.660163 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-67de5831-8e0b-4b21-9e3c-b37491cda98b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:55.661214 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-67de5831-8e0b-4b21-9e3c-b37491cda98b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:55.662207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-0a144b39-a9a7-446b-8ab9-4e0bcc0f4138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049184 Jun 21 18:40:55.662735 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 442/883] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:40:55 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:40:55.673236 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-67de5831-8e0b-4b21-9e3c-b37491cda98b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:55.674070 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-67de5831-8e0b-4b21-9e3c-b37491cda98b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:55.675424 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-67de5831-8e0b-4b21-9e3c-b37491cda98b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:55.676204 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-67de5831-8e0b-4b21-9e3c-b37491cda98b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:55.837215 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-67de5831-8e0b-4b21-9e3c-b37491cda98b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:55.848970 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-67de5831-8e0b-4b21-9e3c-b37491cda98b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:55.851649 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-67de5831-8e0b-4b21-9e3c-b37491cda98b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:55.854153 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-67de5831-8e0b-4b21-9e3c-b37491cda98b tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.201581 Jun 21 18:40:55.858162 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 442/884] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:55 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:40:56.678049 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-eed5ac87-b899-4110-8847-a48d88ed46e3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:56.679160 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-eed5ac87-b899-4110-8847-a48d88ed46e3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:56.688367 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eed5ac87-b899-4110-8847-a48d88ed46e3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:56.689217 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eed5ac87-b899-4110-8847-a48d88ed46e3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:56.690403 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eed5ac87-b899-4110-8847-a48d88ed46e3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:56.691471 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eed5ac87-b899-4110-8847-a48d88ed46e3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:56.765451 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-eed5ac87-b899-4110-8847-a48d88ed46e3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093106 Jun 21 18:40:56.766189 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 443/885] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:40:56 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:40:56.875245 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ba85d632-270b-4cdd-bcfe-db22b5e70580 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:56.876283 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ba85d632-270b-4cdd-bcfe-db22b5e70580 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:56.889107 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ba85d632-270b-4cdd-bcfe-db22b5e70580 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:56.889107 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ba85d632-270b-4cdd-bcfe-db22b5e70580 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:56.889107 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ba85d632-270b-4cdd-bcfe-db22b5e70580 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:56.889107 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ba85d632-270b-4cdd-bcfe-db22b5e70580 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:57.112417 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ba85d632-270b-4cdd-bcfe-db22b5e70580 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:57.124294 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ba85d632-270b-4cdd-bcfe-db22b5e70580 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:57.125801 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ba85d632-270b-4cdd-bcfe-db22b5e70580 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:57.127765 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ba85d632-270b-4cdd-bcfe-db22b5e70580 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.258101 Jun 21 18:40:57.128371 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 443/886] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:56 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:57.785003 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6544fbad-8da8-4d0d-8dea-2f4804d0ea6b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:57.786674 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-6544fbad-8da8-4d0d-8dea-2f4804d0ea6b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:57.795526 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6544fbad-8da8-4d0d-8dea-2f4804d0ea6b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:57.796378 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6544fbad-8da8-4d0d-8dea-2f4804d0ea6b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:57.798365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6544fbad-8da8-4d0d-8dea-2f4804d0ea6b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:57.798365 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6544fbad-8da8-4d0d-8dea-2f4804d0ea6b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:57.855784 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6544fbad-8da8-4d0d-8dea-2f4804d0ea6b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078365 Jun 21 18:40:57.856684 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 444/887] 10.222.0.87 () {58 vars in 1301 bytes} [Tue Jun 21 18:40:57 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 18:40:58.004737 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-49c6bc6b-d803-40df-a4fe-931ae1e59bbf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:58.005388 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-49c6bc6b-d803-40df-a4fe-931ae1e59bbf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:58.037869 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-49c6bc6b-d803-40df-a4fe-931ae1e59bbf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:58.039209 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-49c6bc6b-d803-40df-a4fe-931ae1e59bbf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:58.043309 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-49c6bc6b-d803-40df-a4fe-931ae1e59bbf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:58.046702 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-49c6bc6b-d803-40df-a4fe-931ae1e59bbf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:58.124357 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-49c6bc6b-d803-40df-a4fe-931ae1e59bbf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Going to try to terminate instance {{(pid=118109) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:40:58.153599 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c76c41e1-df34-4b4c-b7d0-7b71c8d15b53 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:58.155147 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c76c41e1-df34-4b4c-b7d0-7b71c8d15b53 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:58.177465 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c76c41e1-df34-4b4c-b7d0-7b71c8d15b53 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:58.178687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c76c41e1-df34-4b4c-b7d0-7b71c8d15b53 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:58.187115 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c76c41e1-df34-4b4c-b7d0-7b71c8d15b53 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:58.193434 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c76c41e1-df34-4b4c-b7d0-7b71c8d15b53 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:58.341600 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:40:58.409390 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-49c6bc6b-d803-40df-a4fe-931ae1e59bbf tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "DELETE /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 204 len: 0 microversion: 2.1 time: 0.418619 Jun 21 18:40:58.411212 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 444/888] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:40:57 2022] DELETE /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:40:58.427650 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ef0ea519-2a89-4e52-b35a-37f645c40f79 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:58.429336 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ef0ea519-2a89-4e52-b35a-37f645c40f79 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:58.443768 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ef0ea519-2a89-4e52-b35a-37f645c40f79 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:58.444930 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ef0ea519-2a89-4e52-b35a-37f645c40f79 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:58.446704 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ef0ea519-2a89-4e52-b35a-37f645c40f79 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:58.447854 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ef0ea519-2a89-4e52-b35a-37f645c40f79 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:58.646409 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c76c41e1-df34-4b4c-b7d0-7b71c8d15b53 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:58.676579 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c76c41e1-df34-4b4c-b7d0-7b71c8d15b53 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:58.688504 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c76c41e1-df34-4b4c-b7d0-7b71c8d15b53 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:58.692132 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c76c41e1-df34-4b4c-b7d0-7b71c8d15b53 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.543355 Jun 21 18:40:58.695174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 445/889] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:58 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:40:58.799031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ef0ea519-2a89-4e52-b35a-37f645c40f79 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:40:58.809091 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ef0ea519-2a89-4e52-b35a-37f645c40f79 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1681 microversion: 2.1 time: 0.390292 Jun 21 18:40:58.810132 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 445/890] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:40:58 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1681 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:40:59.718541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-3b2f77ad-89a0-44d4-a080-b40f478ee624 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:59.718541 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-3b2f77ad-89a0-44d4-a080-b40f478ee624 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:59.725473 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3b2f77ad-89a0-44d4-a080-b40f478ee624 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:59.726094 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3b2f77ad-89a0-44d4-a080-b40f478ee624 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:59.727433 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3b2f77ad-89a0-44d4-a080-b40f478ee624 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:59.727979 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3b2f77ad-89a0-44d4-a080-b40f478ee624 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:59.828323 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-7c49d260-5be0-41b7-b383-3a6df59c5cac tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:40:59.829608 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-7c49d260-5be0-41b7-b383-3a6df59c5cac tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:40:59.851983 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7c49d260-5be0-41b7-b383-3a6df59c5cac tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:59.853408 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7c49d260-5be0-41b7-b383-3a6df59c5cac tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:40:59.854409 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7c49d260-5be0-41b7-b383-3a6df59c5cac tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:40:59.855072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7c49d260-5be0-41b7-b383-3a6df59c5cac tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:00.002829 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-3b2f77ad-89a0-44d4-a080-b40f478ee624 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:00.030847 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-3b2f77ad-89a0-44d4-a080-b40f478ee624 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:00.052515 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-3b2f77ad-89a0-44d4-a080-b40f478ee624 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:00.060452 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-3b2f77ad-89a0-44d4-a080-b40f478ee624 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.346561 Jun 21 18:41:00.065323 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 446/891] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:40:59 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:41:00.179400 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-7c49d260-5be0-41b7-b383-3a6df59c5cac tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:00.196723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-7c49d260-5be0-41b7-b383-3a6df59c5cac tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1681 microversion: 2.1 time: 0.371596 Jun 21 18:41:00.198405 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 446/892] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:40:59 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1681 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:41:01.090386 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-91d2039f-fb33-4105-a110-d61ccbc38298 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:01.096984 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-91d2039f-fb33-4105-a110-d61ccbc38298 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:01.110814 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-91d2039f-fb33-4105-a110-d61ccbc38298 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:01.114549 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-91d2039f-fb33-4105-a110-d61ccbc38298 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:01.118567 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-91d2039f-fb33-4105-a110-d61ccbc38298 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:01.119273 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-91d2039f-fb33-4105-a110-d61ccbc38298 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:01.216769 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-d3be7d43-a8b0-44d3-a8cf-054f661eec8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:01.218101 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-d3be7d43-a8b0-44d3-a8cf-054f661eec8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:01.226966 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d3be7d43-a8b0-44d3-a8cf-054f661eec8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:01.227774 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d3be7d43-a8b0-44d3-a8cf-054f661eec8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:01.228993 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d3be7d43-a8b0-44d3-a8cf-054f661eec8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:01.229685 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d3be7d43-a8b0-44d3-a8cf-054f661eec8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:01.473630 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-91d2039f-fb33-4105-a110-d61ccbc38298 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:01.483534 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-91d2039f-fb33-4105-a110-d61ccbc38298 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:01.501688 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-91d2039f-fb33-4105-a110-d61ccbc38298 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:01.510172 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-91d2039f-fb33-4105-a110-d61ccbc38298 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.417522 Jun 21 18:41:01.511350 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 447/893] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:01 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:41:01.595903 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-d3be7d43-a8b0-44d3-a8cf-054f661eec8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:01.611848 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-d3be7d43-a8b0-44d3-a8cf-054f661eec8b tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1681 microversion: 2.1 time: 0.399355 Jun 21 18:41:01.613413 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 447/894] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:01 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1681 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:41:02.542000 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-ab1ead28-e2e6-4483-8366-b4683a953146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:02.543261 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-ab1ead28-e2e6-4483-8366-b4683a953146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:02.568236 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ab1ead28-e2e6-4483-8366-b4683a953146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:02.568768 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ab1ead28-e2e6-4483-8366-b4683a953146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:02.570987 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ab1ead28-e2e6-4483-8366-b4683a953146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:02.571735 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ab1ead28-e2e6-4483-8366-b4683a953146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:02.668112 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-da335df3-f8c9-4026-ac0c-1d9d270453a3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:02.670107 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-da335df3-f8c9-4026-ac0c-1d9d270453a3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:02.708621 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-da335df3-f8c9-4026-ac0c-1d9d270453a3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:02.709421 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-da335df3-f8c9-4026-ac0c-1d9d270453a3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:02.710920 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-da335df3-f8c9-4026-ac0c-1d9d270453a3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:02.719650 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-da335df3-f8c9-4026-ac0c-1d9d270453a3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:02.940092 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ab1ead28-e2e6-4483-8366-b4683a953146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:02.973274 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ab1ead28-e2e6-4483-8366-b4683a953146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:02.976512 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ab1ead28-e2e6-4483-8366-b4683a953146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:02.978643 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-ab1ead28-e2e6-4483-8366-b4683a953146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.443997 Jun 21 18:41:02.980058 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 448/895] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:02 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:41:03.034084 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-da335df3-f8c9-4026-ac0c-1d9d270453a3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:03.053159 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-da335df3-f8c9-4026-ac0c-1d9d270453a3 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1681 microversion: 2.1 time: 0.417944 Jun 21 18:41:03.054832 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 448/896] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:02 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1681 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:04.012173 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-73f80cb7-71ce-441a-803d-0ccc2abc4167 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:04.014549 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-73f80cb7-71ce-441a-803d-0ccc2abc4167 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:04.027771 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-73f80cb7-71ce-441a-803d-0ccc2abc4167 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:04.029495 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-73f80cb7-71ce-441a-803d-0ccc2abc4167 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:04.031564 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-73f80cb7-71ce-441a-803d-0ccc2abc4167 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:04.032712 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-73f80cb7-71ce-441a-803d-0ccc2abc4167 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:04.090196 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ec01e919-b40b-4784-8021-1592c2604afa tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:04.092336 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ec01e919-b40b-4784-8021-1592c2604afa tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:04.123791 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ec01e919-b40b-4784-8021-1592c2604afa tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:04.128175 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ec01e919-b40b-4784-8021-1592c2604afa tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:04.130214 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ec01e919-b40b-4784-8021-1592c2604afa tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:04.138318 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ec01e919-b40b-4784-8021-1592c2604afa tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:04.523110 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ec01e919-b40b-4784-8021-1592c2604afa tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:04.526924 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-73f80cb7-71ce-441a-803d-0ccc2abc4167 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:04.539923 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-73f80cb7-71ce-441a-803d-0ccc2abc4167 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:04.543507 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-73f80cb7-71ce-441a-803d-0ccc2abc4167 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:04.545316 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-73f80cb7-71ce-441a-803d-0ccc2abc4167 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.541068 Jun 21 18:41:04.557331 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ec01e919-b40b-4784-8021-1592c2604afa tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1681 microversion: 2.1 time: 0.478881 Jun 21 18:41:04.558422 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 449/897] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:04 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1681 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:04.558812 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 449/898] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:04 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:41:05.586172 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-12204b23-ecf7-4f1a-8825-5fbcf907b540 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:05.587745 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-12204b23-ecf7-4f1a-8825-5fbcf907b540 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:05.590298 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f9813742-b504-46c1-a87f-91ca85f0c9ad tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:05.599808 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f9813742-b504-46c1-a87f-91ca85f0c9ad tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:05.611107 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-12204b23-ecf7-4f1a-8825-5fbcf907b540 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:05.612369 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-12204b23-ecf7-4f1a-8825-5fbcf907b540 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:05.615567 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-12204b23-ecf7-4f1a-8825-5fbcf907b540 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:05.616336 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-12204b23-ecf7-4f1a-8825-5fbcf907b540 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:05.631023 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f9813742-b504-46c1-a87f-91ca85f0c9ad tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:05.631909 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f9813742-b504-46c1-a87f-91ca85f0c9ad tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:05.634632 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f9813742-b504-46c1-a87f-91ca85f0c9ad tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:05.635664 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f9813742-b504-46c1-a87f-91ca85f0c9ad tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:05.960772 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-12204b23-ecf7-4f1a-8825-5fbcf907b540 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:05.974368 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-12204b23-ecf7-4f1a-8825-5fbcf907b540 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1681 microversion: 2.1 time: 0.401662 Jun 21 18:41:05.975506 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 450/899] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:05 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1681 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:41:06.031007 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f9813742-b504-46c1-a87f-91ca85f0c9ad tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:06.048171 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f9813742-b504-46c1-a87f-91ca85f0c9ad tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:06.049878 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f9813742-b504-46c1-a87f-91ca85f0c9ad tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:06.051425 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f9813742-b504-46c1-a87f-91ca85f0c9ad tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.488414 Jun 21 18:41:06.052735 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 450/900] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:05 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:41:06.998299 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-01e985f9-b988-40d5-bf62-ba9b4b2e4e2e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:06.999419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-01e985f9-b988-40d5-bf62-ba9b4b2e4e2e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:07.015095 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-01e985f9-b988-40d5-bf62-ba9b4b2e4e2e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:07.015095 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-01e985f9-b988-40d5-bf62-ba9b4b2e4e2e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:07.015095 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-01e985f9-b988-40d5-bf62-ba9b4b2e4e2e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:07.015095 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-01e985f9-b988-40d5-bf62-ba9b4b2e4e2e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:07.077604 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-87b81eed-d834-42bf-8d83-e511e700a579 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:07.079572 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-87b81eed-d834-42bf-8d83-e511e700a579 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:07.097083 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-87b81eed-d834-42bf-8d83-e511e700a579 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:07.097702 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-87b81eed-d834-42bf-8d83-e511e700a579 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:07.099225 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-87b81eed-d834-42bf-8d83-e511e700a579 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:07.099987 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-87b81eed-d834-42bf-8d83-e511e700a579 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:07.342032 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-01e985f9-b988-40d5-bf62-ba9b4b2e4e2e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:07.356879 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-01e985f9-b988-40d5-bf62-ba9b4b2e4e2e tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1681 microversion: 2.1 time: 0.365776 Jun 21 18:41:07.358058 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 451/901] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:06 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1681 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:07.402922 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-87b81eed-d834-42bf-8d83-e511e700a579 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:07.417448 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-87b81eed-d834-42bf-8d83-e511e700a579 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:07.420011 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-87b81eed-d834-42bf-8d83-e511e700a579 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:07.421981 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-87b81eed-d834-42bf-8d83-e511e700a579 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.353189 Jun 21 18:41:07.422777 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 451/902] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:07 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:41:08.389394 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f80bce23-11f8-40a9-bf5c-e00be7fe3489 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:08.390567 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f80bce23-11f8-40a9-bf5c-e00be7fe3489 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:08.402642 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f80bce23-11f8-40a9-bf5c-e00be7fe3489 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:08.403425 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f80bce23-11f8-40a9-bf5c-e00be7fe3489 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:08.404838 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f80bce23-11f8-40a9-bf5c-e00be7fe3489 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:08.405668 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f80bce23-11f8-40a9-bf5c-e00be7fe3489 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:08.415500 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=100 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:41:08.443332 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-44905af1-ff8f-4c79-a040-35f969a9ebab tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:08.444261 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-44905af1-ff8f-4c79-a040-35f969a9ebab tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:08.452485 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-44905af1-ff8f-4c79-a040-35f969a9ebab tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:08.453012 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-44905af1-ff8f-4c79-a040-35f969a9ebab tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:08.454250 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-44905af1-ff8f-4c79-a040-35f969a9ebab tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:08.454937 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-44905af1-ff8f-4c79-a040-35f969a9ebab tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:08.786246 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f80bce23-11f8-40a9-bf5c-e00be7fe3489 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:08.796464 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-44905af1-ff8f-4c79-a040-35f969a9ebab tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:08.797740 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f80bce23-11f8-40a9-bf5c-e00be7fe3489 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1681 microversion: 2.1 time: 0.415359 Jun 21 18:41:08.798481 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 452/903] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:08 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1681 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:08.807396 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-44905af1-ff8f-4c79-a040-35f969a9ebab tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:08.808938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-44905af1-ff8f-4c79-a040-35f969a9ebab tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:08.810227 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-44905af1-ff8f-4c79-a040-35f969a9ebab tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.371690 Jun 21 18:41:08.816576 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 452/904] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:08 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:41:09.823551 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-99801012-2cbd-43ee-8276-4d6ff0518633 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:09.824429 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-99801012-2cbd-43ee-8276-4d6ff0518633 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:09.832681 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-99801012-2cbd-43ee-8276-4d6ff0518633 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:09.833278 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-99801012-2cbd-43ee-8276-4d6ff0518633 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:09.834400 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-99801012-2cbd-43ee-8276-4d6ff0518633 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:09.834942 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-99801012-2cbd-43ee-8276-4d6ff0518633 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:09.837628 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6b5d99a2-fc92-4a6b-83c5-5ff96f186521 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:09.838999 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6b5d99a2-fc92-4a6b-83c5-5ff96f186521 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:09.850523 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6b5d99a2-fc92-4a6b-83c5-5ff96f186521 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:09.851319 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6b5d99a2-fc92-4a6b-83c5-5ff96f186521 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:09.852761 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6b5d99a2-fc92-4a6b-83c5-5ff96f186521 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:09.853498 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6b5d99a2-fc92-4a6b-83c5-5ff96f186521 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:10.076686 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-99801012-2cbd-43ee-8276-4d6ff0518633 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:10.090795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-99801012-2cbd-43ee-8276-4d6ff0518633 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1681 microversion: 2.1 time: 0.270940 Jun 21 18:41:10.092102 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 453/905] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:09 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1681 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:10.105440 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-6b5d99a2-fc92-4a6b-83c5-5ff96f186521 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:10.120413 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-6b5d99a2-fc92-4a6b-83c5-5ff96f186521 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:10.123373 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-6b5d99a2-fc92-4a6b-83c5-5ff96f186521 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:10.125525 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6b5d99a2-fc92-4a6b-83c5-5ff96f186521 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.295076 Jun 21 18:41:10.126573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 453/906] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:09 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:41:11.115279 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-9eb34fc6-47af-442e-b4b0-38c22e2ba0ec tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:11.116207 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-9eb34fc6-47af-442e-b4b0-38c22e2ba0ec tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:11.123899 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9eb34fc6-47af-442e-b4b0-38c22e2ba0ec tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:11.124544 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9eb34fc6-47af-442e-b4b0-38c22e2ba0ec tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:11.125441 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9eb34fc6-47af-442e-b4b0-38c22e2ba0ec tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:11.126016 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9eb34fc6-47af-442e-b4b0-38c22e2ba0ec tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:11.150564 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-96ef1198-ad5f-4146-99db-04e0ab55e006 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:11.151538 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-96ef1198-ad5f-4146-99db-04e0ab55e006 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:11.160203 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-96ef1198-ad5f-4146-99db-04e0ab55e006 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:11.160756 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-96ef1198-ad5f-4146-99db-04e0ab55e006 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:11.162082 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-96ef1198-ad5f-4146-99db-04e0ab55e006 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:11.162505 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-96ef1198-ad5f-4146-99db-04e0ab55e006 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:11.413449 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-9eb34fc6-47af-442e-b4b0-38c22e2ba0ec tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:11.428000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-96ef1198-ad5f-4146-99db-04e0ab55e006 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:11.435898 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-9eb34fc6-47af-442e-b4b0-38c22e2ba0ec tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1681 microversion: 2.1 time: 0.324843 Jun 21 18:41:11.437127 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 454/907] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:11 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1681 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:11.440792 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-96ef1198-ad5f-4146-99db-04e0ab55e006 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:11.442514 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-96ef1198-ad5f-4146-99db-04e0ab55e006 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:11.443990 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-96ef1198-ad5f-4146-99db-04e0ab55e006 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.298909 Jun 21 18:41:11.444729 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 454/908] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:11 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:41:12.463427 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-817049a0-4836-4979-86b9-bb8d8e24d138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:12.464786 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-817049a0-4836-4979-86b9-bb8d8e24d138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:12.469555 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-11986d5a-fe2f-466d-9f63-d453a05bd8e9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:12.471903 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-11986d5a-fe2f-466d-9f63-d453a05bd8e9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:12.478485 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-817049a0-4836-4979-86b9-bb8d8e24d138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:12.479498 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-817049a0-4836-4979-86b9-bb8d8e24d138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:12.481313 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-817049a0-4836-4979-86b9-bb8d8e24d138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:12.482346 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-817049a0-4836-4979-86b9-bb8d8e24d138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:12.486658 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-11986d5a-fe2f-466d-9f63-d453a05bd8e9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:12.487420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-11986d5a-fe2f-466d-9f63-d453a05bd8e9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:12.489392 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-11986d5a-fe2f-466d-9f63-d453a05bd8e9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:12.490594 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-11986d5a-fe2f-466d-9f63-d453a05bd8e9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:12.871915 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-11986d5a-fe2f-466d-9f63-d453a05bd8e9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:12.889930 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-11986d5a-fe2f-466d-9f63-d453a05bd8e9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:12.893831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-11986d5a-fe2f-466d-9f63-d453a05bd8e9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:12.897102 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-11986d5a-fe2f-466d-9f63-d453a05bd8e9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.434819 Jun 21 18:41:12.897390 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-817049a0-4836-4979-86b9-bb8d8e24d138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:12.899042 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 455/909] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:12 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:41:12.906549 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-817049a0-4836-4979-86b9-bb8d8e24d138 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1681 microversion: 2.1 time: 0.452104 Jun 21 18:41:12.917210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 455/910] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:12 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1681 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:13.936137 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-93007e30-231e-4ffe-a7c7-02164f18c773 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:13.942630 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-93007e30-231e-4ffe-a7c7-02164f18c773 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:13.962215 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-93007e30-231e-4ffe-a7c7-02164f18c773 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:13.962837 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-93007e30-231e-4ffe-a7c7-02164f18c773 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:13.964420 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-93007e30-231e-4ffe-a7c7-02164f18c773 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:13.965441 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-93007e30-231e-4ffe-a7c7-02164f18c773 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:14.039566 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-93007e30-231e-4ffe-a7c7-02164f18c773 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:14.041046 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-93007e30-231e-4ffe-a7c7-02164f18c773 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:14.043341 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.objects.instance [None req-93007e30-231e-4ffe-a7c7-02164f18c773 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lazy-loading 'fault' on Instance uuid 031fed05-1de1-49b6-8325-7a5ab4f19f1f {{(pid=118108) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:41:14.126899 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-93007e30-231e-4ffe-a7c7-02164f18c773 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144c9c31ed9b469aa200dcb16c89ab4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53e2bb9f793041c2aef6e222b76c3961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:14.143173 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-93007e30-231e-4ffe-a7c7-02164f18c773 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 200 len: 1331 microversion: 2.1 time: 0.218755 Jun 21 18:41:14.144368 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 456/911] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:13 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 1331 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:41:14.151985 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-bc320379-6c8f-44a6-8a73-6f6b3c77cd60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:14.152832 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-bc320379-6c8f-44a6-8a73-6f6b3c77cd60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:14.156895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-2249a070-c02c-4545-b497-c2b27bc7863f req-d36de47b-58c1-4505-9487-de300e2b21e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "031fed05-1de1-49b6-8325-7a5ab4f19f1f", "name": "network-vif-deleted", "tag": "561631ac-1f22-45ce-a83d-d5eb01c68fdb"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:41:14.161707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bc320379-6c8f-44a6-8a73-6f6b3c77cd60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:14.162618 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bc320379-6c8f-44a6-8a73-6f6b3c77cd60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:14.163708 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bc320379-6c8f-44a6-8a73-6f6b3c77cd60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:14.164463 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bc320379-6c8f-44a6-8a73-6f6b3c77cd60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:14.174239 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-2249a070-c02c-4545-b497-c2b27bc7863f req-d36de47b-58c1-4505-9487-de300e2b21e0 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:14.175313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-2249a070-c02c-4545-b497-c2b27bc7863f req-d36de47b-58c1-4505-9487-de300e2b21e0 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:14.197608 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-2249a070-c02c-4545-b497-c2b27bc7863f req-d36de47b-58c1-4505-9487-de300e2b21e0 service nova] Creating event network-vif-deleted:561631ac-1f22-45ce-a83d-d5eb01c68fdb for instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f on hv-cinder-84460 Jun 21 18:41:14.207062 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-2249a070-c02c-4545-b497-c2b27bc7863f req-d36de47b-58c1-4505-9487-de300e2b21e0 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.442465 Jun 21 18:41:14.209783 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 456/912] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:41:14.389029 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-bc320379-6c8f-44a6-8a73-6f6b3c77cd60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:14.416109 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-bc320379-6c8f-44a6-8a73-6f6b3c77cd60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:14.419492 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-bc320379-6c8f-44a6-8a73-6f6b3c77cd60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:14.421525 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-bc320379-6c8f-44a6-8a73-6f6b3c77cd60 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.275318 Jun 21 18:41:14.422604 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 457/913] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:14 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:41:15.165507 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-0cb76cef-4a20-4eb1-8bbd-82ad102b61bc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:15.166450 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-0cb76cef-4a20-4eb1-8bbd-82ad102b61bc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:15.177014 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0cb76cef-4a20-4eb1-8bbd-82ad102b61bc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:15.178787 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0cb76cef-4a20-4eb1-8bbd-82ad102b61bc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:15.179900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0cb76cef-4a20-4eb1-8bbd-82ad102b61bc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:15.180597 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0cb76cef-4a20-4eb1-8bbd-82ad102b61bc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:15.207540 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-0cb76cef-4a20-4eb1-8bbd-82ad102b61bc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] HTTP exception thrown: Instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f could not be found. Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-0cb76cef-4a20-4eb1-8bbd-82ad102b61bc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Request method failure captured: Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f HTTP/1.1 Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg4ZMAWXxe61N6ctbFJeKvVgvvqMTa2oRmY5e2O5Oda6LMfZg9xpstvKI3ZJkXmTItstccH4E1PbiQoDoOZ0pGDVym3uwQfnL3hWTQsURjldIWUJ8D1X_g1vsEm62qgxRWdgSwijxdtKtfaabBZ19cJ69ajwcodYMs6ciOaGSF1872Y Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:41:15.209881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:41:15.212796 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:41:15.212796 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:15.212796 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:41:15.212796 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:15.212796 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:41:15.212796 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:41:15.212796 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:41:15.212796 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: 144c9c31ed9b469aa200dcb16c89ab4e Jun 21 18:41:15.212796 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:41:15.212796 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:41:15.212796 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f could not be found. Jun 21 18:41:15.212796 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': '031fed05-1de1-49b6-8325-7a5ab4f19f1f'} Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f could not be found. Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:41:15.214502 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:41:15.217313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:41:15.217313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:41:15.217313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:41:15.217313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:41:15.217313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:41:15.217313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:41:15.217313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:41:15.217313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f could not be found. Jun 21 18:41:15.217313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:15.217313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:41:15.217313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:15.217313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:15.217313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:41:15.217313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:41:15.217313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:41:15.217313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:41:15.217313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f could not be found. Jun 21 18:41:15.217313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:15.219756 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-0cb76cef-4a20-4eb1-8bbd-82ad102b61bc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Returning 404 to user: Instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:41:15.219756 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-0cb76cef-4a20-4eb1-8bbd-82ad102b61bc tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 404 len: 111 microversion: 2.1 time: 0.055379 Jun 21 18:41:15.222124 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 457/914] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:15 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:41:15.231603 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4cbd9604-f779-4c1f-a494-a152bebd8e43 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '.version_select at 0x7fd8bb92c8b0>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:15.266649 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4cbd9604-f779-4c1f-a494-a152bebd8e43 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-936788233" status: 202 len: 0 microversion: 2.1 time: 0.042650 Jun 21 18:41:15.268275 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 458/915] 10.222.0.87 () {58 vars in 1217 bytes} [Tue Jun 21 18:41:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-936788233 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:41:15.453816 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f7eb0343-5e56-4434-8d34-fec7dd3ac61c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:15.454811 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f7eb0343-5e56-4434-8d34-fec7dd3ac61c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:15.462555 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7eb0343-5e56-4434-8d34-fec7dd3ac61c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:15.462993 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7eb0343-5e56-4434-8d34-fec7dd3ac61c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:15.463802 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7eb0343-5e56-4434-8d34-fec7dd3ac61c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:15.464236 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7eb0343-5e56-4434-8d34-fec7dd3ac61c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:15.740267 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f7eb0343-5e56-4434-8d34-fec7dd3ac61c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:15.753855 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f7eb0343-5e56-4434-8d34-fec7dd3ac61c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:15.755718 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f7eb0343-5e56-4434-8d34-fec7dd3ac61c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:15.757304 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f7eb0343-5e56-4434-8d34-fec7dd3ac61c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.310048 Jun 21 18:41:15.758213 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 458/916] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:15 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:41:16.790535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4f1df091-fee7-4958-becf-0b3e636a2b2f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:16.791770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4f1df091-fee7-4958-becf-0b3e636a2b2f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:16.804995 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4f1df091-fee7-4958-becf-0b3e636a2b2f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:16.805922 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4f1df091-fee7-4958-becf-0b3e636a2b2f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:16.807358 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4f1df091-fee7-4958-becf-0b3e636a2b2f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:16.808245 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4f1df091-fee7-4958-becf-0b3e636a2b2f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:17.023534 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-4f1df091-fee7-4958-becf-0b3e636a2b2f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:17.033876 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-4f1df091-fee7-4958-becf-0b3e636a2b2f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:17.035803 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-4f1df091-fee7-4958-becf-0b3e636a2b2f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:17.037239 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4f1df091-fee7-4958-becf-0b3e636a2b2f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.256274 Jun 21 18:41:17.038020 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 459/917] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:16 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:41:17.526991 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-78d8688a-8bb5-4bd6-9b2a-6416b3b4d717 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:17.527879 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-78d8688a-8bb5-4bd6-9b2a-6416b3b4d717 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:17.535755 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-78d8688a-8bb5-4bd6-9b2a-6416b3b4d717 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:17.536200 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-78d8688a-8bb5-4bd6-9b2a-6416b3b4d717 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:17.536996 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-78d8688a-8bb5-4bd6-9b2a-6416b3b4d717 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:17.537427 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-78d8688a-8bb5-4bd6-9b2a-6416b3b4d717 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:17.554133 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-78d8688a-8bb5-4bd6-9b2a-6416b3b4d717 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] HTTP exception thrown: Instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f could not be found. Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-78d8688a-8bb5-4bd6-9b2a-6416b3b4d717 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Request method failure captured: Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: DELETE /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f HTTP/1.1 Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg4ZMAWXxe61N6ctbFJeKvVgvvqMTa2oRmY5e2O5Oda6LMfZg9xpstvKI3ZJkXmTItstccH4E1PbiQoDoOZ0pGDVym3uwQfnL3hWTQsURjldIWUJ8D1X_g1vsEm62qgxRWdgSwijxdtKtfaabBZ19cJ69ajwcodYMs6ciOaGSF1872Y Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:41:17.555739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:41:17.557960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:41:17.557960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:17.557960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:41:17.557960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:17.557960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:41:17.557960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:41:17.557960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:41:17.557960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: 144c9c31ed9b469aa200dcb16c89ab4e Jun 21 18:41:17.557960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:41:17.557960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:41:17.557960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f could not be found. Jun 21 18:41:17.557960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': '031fed05-1de1-49b6-8325-7a5ab4f19f1f'} Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f could not be found. Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:41:17.559174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f could not be found. Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f could not be found. Jun 21 18:41:17.560657 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:17.563371 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-78d8688a-8bb5-4bd6-9b2a-6416b3b4d717 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Returning 404 to user: Instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:41:17.563371 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-78d8688a-8bb5-4bd6-9b2a-6416b3b4d717 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "DELETE /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 404 len: 111 microversion: 2.1 time: 0.034372 Jun 21 18:41:17.563371 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 459/918] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:41:17 2022] DELETE /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 18:41:17.568212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-39d150e5-7321-4d57-b300-5bb88029072c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:17.568873 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-39d150e5-7321-4d57-b300-5bb88029072c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 031fed05-1de1-49b6-8325-7a5ab4f19f1f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:17.575909 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-39d150e5-7321-4d57-b300-5bb88029072c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:17.576355 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-39d150e5-7321-4d57-b300-5bb88029072c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:17.577144 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-39d150e5-7321-4d57-b300-5bb88029072c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:17.577581 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-39d150e5-7321-4d57-b300-5bb88029072c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:17.597245 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-39d150e5-7321-4d57-b300-5bb88029072c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] HTTP exception thrown: Instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f could not be found. Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-39d150e5-7321-4d57-b300-5bb88029072c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Request method failure captured: Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f HTTP/1.1 Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABisg4ZMAWXxe61N6ctbFJeKvVgvvqMTa2oRmY5e2O5Oda6LMfZg9xpstvKI3ZJkXmTItstccH4E1PbiQoDoOZ0pGDVym3uwQfnL3hWTQsURjldIWUJ8D1X_g1vsEm62qgxRWdgSwijxdtKtfaabBZ19cJ69ajwcodYMs6ciOaGSF1872Y Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:41:17.599158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:41:17.601982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:41:17.601982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:17.601982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:41:17.601982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:17.601982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:41:17.601982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:41:17.601982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:41:17.601982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 144c9c31ed9b469aa200dcb16c89ab4e Jun 21 18:41:17.601982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:41:17.601982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:41:17.601982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f could not be found. Jun 21 18:41:17.601982 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': '031fed05-1de1-49b6-8325-7a5ab4f19f1f'} Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f could not be found. Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:41:17.604068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:41:17.606210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:41:17.606210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:41:17.606210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:41:17.606210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:41:17.606210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:41:17.606210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:41:17.606210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:41:17.606210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f could not be found. Jun 21 18:41:17.606210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:41:17.606210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:41:17.606210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:41:17.606210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:17.606210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:41:17.606210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:41:17.606210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:41:17.606210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:41:17.606210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f could not be found. Jun 21 18:41:17.606210 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:41:17.608620 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-39d150e5-7321-4d57-b300-5bb88029072c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Returning 404 to user: Instance 031fed05-1de1-49b6-8325-7a5ab4f19f1f could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:41:17.608620 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-39d150e5-7321-4d57-b300-5bb88029072c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f" status: 404 len: 111 microversion: 2.1 time: 0.038479 Jun 21 18:41:17.608620 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 460/919] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:17 2022] GET /compute/v2.1/servers/031fed05-1de1-49b6-8325-7a5ab4f19f1f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:41:18.062693 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f7ec05a9-8356-4eb4-8c0c-97e11b0ff400 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:18.063717 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f7ec05a9-8356-4eb4-8c0c-97e11b0ff400 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:18.074138 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7ec05a9-8356-4eb4-8c0c-97e11b0ff400 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:18.074650 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7ec05a9-8356-4eb4-8c0c-97e11b0ff400 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:18.075970 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7ec05a9-8356-4eb4-8c0c-97e11b0ff400 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:18.076520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7ec05a9-8356-4eb4-8c0c-97e11b0ff400 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:18.291712 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f7ec05a9-8356-4eb4-8c0c-97e11b0ff400 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:18.302238 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f7ec05a9-8356-4eb4-8c0c-97e11b0ff400 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:18.304304 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f7ec05a9-8356-4eb4-8c0c-97e11b0ff400 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:18.305871 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f7ec05a9-8356-4eb4-8c0c-97e11b0ff400 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.251982 Jun 21 18:41:18.306612 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 460/920] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:18 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:41:19.328712 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2255fa1b-58c9-43d3-b187-4817cbaba023 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:19.330292 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-2255fa1b-58c9-43d3-b187-4817cbaba023 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:19.346238 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2255fa1b-58c9-43d3-b187-4817cbaba023 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:19.346678 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2255fa1b-58c9-43d3-b187-4817cbaba023 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:19.347886 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2255fa1b-58c9-43d3-b187-4817cbaba023 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:19.348545 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2255fa1b-58c9-43d3-b187-4817cbaba023 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:19.525831 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2255fa1b-58c9-43d3-b187-4817cbaba023 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:19.538858 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2255fa1b-58c9-43d3-b187-4817cbaba023 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:19.540802 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2255fa1b-58c9-43d3-b187-4817cbaba023 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:19.542305 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2255fa1b-58c9-43d3-b187-4817cbaba023 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.219808 Jun 21 18:41:19.543374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 461/921] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:19 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:41:20.562915 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c16675cd-f233-4784-9c52-3ce25c845414 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:20.563646 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c16675cd-f233-4784-9c52-3ce25c845414 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:20.571335 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c16675cd-f233-4784-9c52-3ce25c845414 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:20.571784 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c16675cd-f233-4784-9c52-3ce25c845414 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:20.572571 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c16675cd-f233-4784-9c52-3ce25c845414 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:20.573006 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c16675cd-f233-4784-9c52-3ce25c845414 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:20.735969 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c16675cd-f233-4784-9c52-3ce25c845414 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:20.745838 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c16675cd-f233-4784-9c52-3ce25c845414 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:20.748158 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c16675cd-f233-4784-9c52-3ce25c845414 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:20.748739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c16675cd-f233-4784-9c52-3ce25c845414 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.190245 Jun 21 18:41:20.749352 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 461/922] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:20 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:41:21.781515 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-01f67fe6-2456-476c-80d0-aa8d5fe50e30 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:21.782599 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-01f67fe6-2456-476c-80d0-aa8d5fe50e30 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:21.794903 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-01f67fe6-2456-476c-80d0-aa8d5fe50e30 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:21.795643 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-01f67fe6-2456-476c-80d0-aa8d5fe50e30 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:21.797004 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-01f67fe6-2456-476c-80d0-aa8d5fe50e30 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:21.797797 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-01f67fe6-2456-476c-80d0-aa8d5fe50e30 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:21.947950 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-be7814d4-52ca-4d58-ace9-72f1155e003c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:21.948619 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-be7814d4-52ca-4d58-ace9-72f1155e003c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:21.956671 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-be7814d4-52ca-4d58-ace9-72f1155e003c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:21.957118 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-be7814d4-52ca-4d58-ace9-72f1155e003c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:21.957947 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-be7814d4-52ca-4d58-ace9-72f1155e003c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:21.958388 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-be7814d4-52ca-4d58-ace9-72f1155e003c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:21.982226 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-be7814d4-52ca-4d58-ace9-72f1155e003c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] HTTP exception thrown: Instance 095e34aa-ee35-4453-b440-559af6d24823 could not be found. Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-be7814d4-52ca-4d58-ace9-72f1155e003c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Request method failure captured: Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: DELETE /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 HTTP/1.1 Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg4ZMAWXxe61N6ctbFJeKvVgvvqMTa2oRmY5e2O5Oda6LMfZg9xpstvKI3ZJkXmTItstccH4E1PbiQoDoOZ0pGDVym3uwQfnL3hWTQsURjldIWUJ8D1X_g1vsEm62qgxRWdgSwijxdtKtfaabBZ19cJ69ajwcodYMs6ciOaGSF1872Y Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:41:21.985378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:41:21.988547 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:41:21.988547 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:21.988547 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:41:21.988547 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:21.988547 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:41:21.988547 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:41:21.988547 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:41:21.988547 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: 144c9c31ed9b469aa200dcb16c89ab4e Jun 21 18:41:21.988547 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:41:21.988547 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:41:21.988547 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance 095e34aa-ee35-4453-b440-559af6d24823 could not be found. Jun 21 18:41:21.988547 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': '095e34aa-ee35-4453-b440-559af6d24823'} Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 095e34aa-ee35-4453-b440-559af6d24823 could not be found. Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:41:21.990061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 095e34aa-ee35-4453-b440-559af6d24823 could not be found. Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 095e34aa-ee35-4453-b440-559af6d24823 could not be found. Jun 21 18:41:21.992675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:21.995384 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-be7814d4-52ca-4d58-ace9-72f1155e003c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Returning 404 to user: Instance 095e34aa-ee35-4453-b440-559af6d24823 could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:41:21.995384 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-be7814d4-52ca-4d58-ace9-72f1155e003c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "DELETE /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 404 len: 111 microversion: 2.1 time: 0.043912 Jun 21 18:41:21.995384 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 462/923] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:41:21 2022] DELETE /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:41:22.000668 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-055ff5aa-ebc8-4da6-84a7-3555f161903c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:22.001792 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-055ff5aa-ebc8-4da6-84a7-3555f161903c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 095e34aa-ee35-4453-b440-559af6d24823] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:22.007649 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-01f67fe6-2456-476c-80d0-aa8d5fe50e30 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:22.011505 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-055ff5aa-ebc8-4da6-84a7-3555f161903c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:22.012475 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-055ff5aa-ebc8-4da6-84a7-3555f161903c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:22.013591 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-055ff5aa-ebc8-4da6-84a7-3555f161903c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:22.014162 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-055ff5aa-ebc8-4da6-84a7-3555f161903c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:22.019472 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-01f67fe6-2456-476c-80d0-aa8d5fe50e30 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:22.021505 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-01f67fe6-2456-476c-80d0-aa8d5fe50e30 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:22.023188 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-01f67fe6-2456-476c-80d0-aa8d5fe50e30 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.249027 Jun 21 18:41:22.024590 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 462/924] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:21 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:41:22.036722 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-055ff5aa-ebc8-4da6-84a7-3555f161903c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] HTTP exception thrown: Instance 095e34aa-ee35-4453-b440-559af6d24823 could not be found. Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-055ff5aa-ebc8-4da6-84a7-3555f161903c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Request method failure captured: Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 HTTP/1.1 Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg4ZMAWXxe61N6ctbFJeKvVgvvqMTa2oRmY5e2O5Oda6LMfZg9xpstvKI3ZJkXmTItstccH4E1PbiQoDoOZ0pGDVym3uwQfnL3hWTQsURjldIWUJ8D1X_g1vsEm62qgxRWdgSwijxdtKtfaabBZ19cJ69ajwcodYMs6ciOaGSF1872Y Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:41:22.040000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:41:22.042397 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:41:22.042397 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:22.042397 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:41:22.042397 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:22.042397 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:41:22.042397 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:41:22.042397 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:41:22.042397 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: 144c9c31ed9b469aa200dcb16c89ab4e Jun 21 18:41:22.042397 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:41:22.042397 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:41:22.042397 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance 095e34aa-ee35-4453-b440-559af6d24823 could not be found. Jun 21 18:41:22.042397 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': '095e34aa-ee35-4453-b440-559af6d24823'} Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 095e34aa-ee35-4453-b440-559af6d24823 could not be found. Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:41:22.043526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:41:22.045772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:41:22.045772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:41:22.045772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:41:22.045772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:41:22.045772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:41:22.045772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:41:22.045772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:41:22.045772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 095e34aa-ee35-4453-b440-559af6d24823 could not be found. Jun 21 18:41:22.045772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:22.045772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:41:22.045772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:22.045772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:22.045772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:41:22.045772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:41:22.045772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:41:22.045772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:41:22.045772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 095e34aa-ee35-4453-b440-559af6d24823 could not be found. Jun 21 18:41:22.045772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:22.048090 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-055ff5aa-ebc8-4da6-84a7-3555f161903c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Returning 404 to user: Instance 095e34aa-ee35-4453-b440-559af6d24823 could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:41:22.048090 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-055ff5aa-ebc8-4da6-84a7-3555f161903c tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823" status: 404 len: 111 microversion: 2.1 time: 0.046860 Jun 21 18:41:22.048090 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 463/925] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:21 2022] GET /compute/v2.1/servers/095e34aa-ee35-4453-b440-559af6d24823 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 18:41:22.059329 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-493c51e8-ebb2-46bd-856e-75d311d694f0 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:22.060324 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-493c51e8-ebb2-46bd-856e-75d311d694f0 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:22.063804 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:41:22.078042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-493c51e8-ebb2-46bd-856e-75d311d694f0 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:22.078042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-493c51e8-ebb2-46bd-856e-75d311d694f0 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:22.078042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-493c51e8-ebb2-46bd-856e-75d311d694f0 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:22.078042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-493c51e8-ebb2-46bd-856e-75d311d694f0 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:22.108197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-493c51e8-ebb2-46bd-856e-75d311d694f0 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] HTTP exception thrown: Instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a could not be found. Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-493c51e8-ebb2-46bd-856e-75d311d694f0 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Request method failure captured: Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: DELETE /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a HTTP/1.1 Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABisg4ZMAWXxe61N6ctbFJeKvVgvvqMTa2oRmY5e2O5Oda6LMfZg9xpstvKI3ZJkXmTItstccH4E1PbiQoDoOZ0pGDVym3uwQfnL3hWTQsURjldIWUJ8D1X_g1vsEm62qgxRWdgSwijxdtKtfaabBZ19cJ69ajwcodYMs6ciOaGSF1872Y Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:41:22.111328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:41:22.114443 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:41:22.114443 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:22.114443 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:41:22.114443 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:22.114443 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:41:22.114443 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:41:22.114443 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:41:22.114443 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 144c9c31ed9b469aa200dcb16c89ab4e Jun 21 18:41:22.114443 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:41:22.114443 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:41:22.114443 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a could not be found. Jun 21 18:41:22.114443 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': '0311fe1f-2643-49b9-89a6-ebfb7d63430a'} Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a could not be found. Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:41:22.116044 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a could not be found. Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a could not be found. Jun 21 18:41:22.118301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:41:22.120690 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-493c51e8-ebb2-46bd-856e-75d311d694f0 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Returning 404 to user: Instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:41:22.120690 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-493c51e8-ebb2-46bd-856e-75d311d694f0 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "DELETE /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 404 len: 111 microversion: 2.1 time: 0.062399 Jun 21 18:41:22.120690 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 463/926] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:41:22 2022] DELETE /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:41:22.126136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-371674fb-355d-48d4-b2c4-29c6b95f4dfd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:22.126928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-371674fb-355d-48d4-b2c4-29c6b95f4dfd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: 0311fe1f-2643-49b9-89a6-ebfb7d63430a] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:22.135556 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-371674fb-355d-48d4-b2c4-29c6b95f4dfd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:22.136358 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-371674fb-355d-48d4-b2c4-29c6b95f4dfd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:22.137774 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-371674fb-355d-48d4-b2c4-29c6b95f4dfd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:22.138754 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-371674fb-355d-48d4-b2c4-29c6b95f4dfd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:22.167064 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-371674fb-355d-48d4-b2c4-29c6b95f4dfd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] HTTP exception thrown: Instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a could not be found. Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-371674fb-355d-48d4-b2c4-29c6b95f4dfd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Request method failure captured: Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a HTTP/1.1 Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg4ZMAWXxe61N6ctbFJeKvVgvvqMTa2oRmY5e2O5Oda6LMfZg9xpstvKI3ZJkXmTItstccH4E1PbiQoDoOZ0pGDVym3uwQfnL3hWTQsURjldIWUJ8D1X_g1vsEm62qgxRWdgSwijxdtKtfaabBZ19cJ69ajwcodYMs6ciOaGSF1872Y Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:41:22.170078 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:41:22.171615 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:41:22.171615 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:22.171615 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:41:22.171615 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:22.171615 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:41:22.171615 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:41:22.171615 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:41:22.171615 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: 144c9c31ed9b469aa200dcb16c89ab4e Jun 21 18:41:22.171615 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:41:22.171615 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:41:22.171615 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a could not be found. Jun 21 18:41:22.171615 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': '0311fe1f-2643-49b9-89a6-ebfb7d63430a'} Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a could not be found. Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:41:22.172520 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:41:22.174116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:41:22.174116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:41:22.174116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:41:22.174116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:41:22.174116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:41:22.174116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:41:22.174116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:41:22.174116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a could not be found. Jun 21 18:41:22.174116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:22.174116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:41:22.174116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:22.174116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:22.174116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:41:22.174116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:41:22.174116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:41:22.174116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:41:22.174116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a could not be found. Jun 21 18:41:22.174116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:22.175370 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-371674fb-355d-48d4-b2c4-29c6b95f4dfd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Returning 404 to user: Instance 0311fe1f-2643-49b9-89a6-ebfb7d63430a could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:41:22.175370 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-371674fb-355d-48d4-b2c4-29c6b95f4dfd tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a" status: 404 len: 111 microversion: 2.1 time: 0.051227 Jun 21 18:41:22.175370 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 464/927] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:22 2022] GET /compute/v2.1/servers/0311fe1f-2643-49b9-89a6-ebfb7d63430a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:41:23.057589 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-aa150f1a-ac55-493e-b605-8a8c2f213051 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:23.058440 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-aa150f1a-ac55-493e-b605-8a8c2f213051 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:23.066076 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-aa150f1a-ac55-493e-b605-8a8c2f213051 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:23.066524 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-aa150f1a-ac55-493e-b605-8a8c2f213051 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:23.067343 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-aa150f1a-ac55-493e-b605-8a8c2f213051 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:23.067759 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-aa150f1a-ac55-493e-b605-8a8c2f213051 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:23.239228 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-aa150f1a-ac55-493e-b605-8a8c2f213051 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:23.249250 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-aa150f1a-ac55-493e-b605-8a8c2f213051 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:23.250809 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-aa150f1a-ac55-493e-b605-8a8c2f213051 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:23.252309 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-aa150f1a-ac55-493e-b605-8a8c2f213051 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.198624 Jun 21 18:41:23.252896 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 464/928] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:23 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:41:23.369110 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6c8481e0-c6d6-4e52-8e38-635894997047 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:23.369745 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6c8481e0-c6d6-4e52-8e38-635894997047 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:23.377128 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6c8481e0-c6d6-4e52-8e38-635894997047 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:23.377653 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6c8481e0-c6d6-4e52-8e38-635894997047 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:23.378506 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6c8481e0-c6d6-4e52-8e38-635894997047 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:23.378952 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6c8481e0-c6d6-4e52-8e38-635894997047 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:23.394827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-6c8481e0-c6d6-4e52-8e38-635894997047 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] HTTP exception thrown: Instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 could not be found. Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6c8481e0-c6d6-4e52-8e38-635894997047 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Request method failure captured: Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: DELETE /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 HTTP/1.1 Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABisg4ZMAWXxe61N6ctbFJeKvVgvvqMTa2oRmY5e2O5Oda6LMfZg9xpstvKI3ZJkXmTItstccH4E1PbiQoDoOZ0pGDVym3uwQfnL3hWTQsURjldIWUJ8D1X_g1vsEm62qgxRWdgSwijxdtKtfaabBZ19cJ69ajwcodYMs6ciOaGSF1872Y Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:41:23.396516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:41:23.399097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:41:23.399097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:23.399097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:41:23.399097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:23.399097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:41:23.399097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:41:23.399097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:41:23.399097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: 144c9c31ed9b469aa200dcb16c89ab4e Jun 21 18:41:23.399097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:41:23.399097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:41:23.399097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 could not be found. Jun 21 18:41:23.399097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': 'dd9d70a7-2f59-4922-a22c-14fe01056ae4'} Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 could not be found. Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:41:23.400543 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 could not be found. Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 could not be found. Jun 21 18:41:23.402799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:41:23.405326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6c8481e0-c6d6-4e52-8e38-635894997047 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Returning 404 to user: Instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:41:23.405326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6c8481e0-c6d6-4e52-8e38-635894997047 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "DELETE /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 404 len: 111 microversion: 2.1 time: 0.033831 Jun 21 18:41:23.405326 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 465/929] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:41:23 2022] DELETE /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:41:23.409325 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f01fb992-8b81-4f87-8062-0c638e9f8823 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:23.410004 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f01fb992-8b81-4f87-8062-0c638e9f8823 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] [instance: dd9d70a7-2f59-4922-a22c-14fe01056ae4] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:23.416696 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f01fb992-8b81-4f87-8062-0c638e9f8823 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:23.417146 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f01fb992-8b81-4f87-8062-0c638e9f8823 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:23.417942 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f01fb992-8b81-4f87-8062-0c638e9f8823 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:23.418383 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f01fb992-8b81-4f87-8062-0c638e9f8823 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:23.434502 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-f01fb992-8b81-4f87-8062-0c638e9f8823 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] HTTP exception thrown: Instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 could not be found. Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f01fb992-8b81-4f87-8062-0c638e9f8823 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Request method failure captured: Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 HTTP/1.1 Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABisg4ZMAWXxe61N6ctbFJeKvVgvvqMTa2oRmY5e2O5Oda6LMfZg9xpstvKI3ZJkXmTItstccH4E1PbiQoDoOZ0pGDVym3uwQfnL3hWTQsURjldIWUJ8D1X_g1vsEm62qgxRWdgSwijxdtKtfaabBZ19cJ69ajwcodYMs6ciOaGSF1872Y Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:41:23.436054 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:41:23.437689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_53e2bb9f793041c2aef6e222b76c3961"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:41:23.437689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:23.437689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 53e2bb9f793041c2aef6e222b76c3961 Jun 21 18:41:23.437689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1705495449 Jun 21 18:41:23.437689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:41:23.437689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:41:23.437689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:41:23.437689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 144c9c31ed9b469aa200dcb16c89ab4e Jun 21 18:41:23.437689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-AttachVolumeNegativeTest-1705495449-project Jun 21 18:41:23.437689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:41:23.437689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 could not be found. Jun 21 18:41:23.437689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': 'dd9d70a7-2f59-4922-a22c-14fe01056ae4'} Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 could not be found. Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:41:23.438596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:41:23.440138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:41:23.440138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:41:23.440138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:41:23.440138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:41:23.440138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:41:23.440138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:41:23.440138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:41:23.440138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 could not be found. Jun 21 18:41:23.440138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:41:23.440138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:41:23.440138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:41:23.440138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:41:23.440138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:41:23.440138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:41:23.440138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:41:23.440138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:41:23.440138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 could not be found. Jun 21 18:41:23.440138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:41:23.441460 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f01fb992-8b81-4f87-8062-0c638e9f8823 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] Returning 404 to user: Instance dd9d70a7-2f59-4922-a22c-14fe01056ae4 could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:41:23.441460 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f01fb992-8b81-4f87-8062-0c638e9f8823 tempest-AttachVolumeNegativeTest-1705495449 tempest-AttachVolumeNegativeTest-1705495449-project] 10.222.0.87 "GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4" status: 404 len: 111 microversion: 2.1 time: 0.032449 Jun 21 18:41:23.441460 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 465/930] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:41:23 2022] GET /compute/v2.1/servers/dd9d70a7-2f59-4922-a22c-14fe01056ae4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:41:24.294817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bd858402-eb40-40db-bd4b-65c82f79460c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:24.296023 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-bd858402-eb40-40db-bd4b-65c82f79460c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:24.307346 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bd858402-eb40-40db-bd4b-65c82f79460c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:24.307791 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bd858402-eb40-40db-bd4b-65c82f79460c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:24.308582 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bd858402-eb40-40db-bd4b-65c82f79460c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:24.309012 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bd858402-eb40-40db-bd4b-65c82f79460c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:24.316226 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=100 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:41:24.890641 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-bd858402-eb40-40db-bd4b-65c82f79460c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:24.903435 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-bd858402-eb40-40db-bd4b-65c82f79460c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:24.905505 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-bd858402-eb40-40db-bd4b-65c82f79460c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:24.906861 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-bd858402-eb40-40db-bd4b-65c82f79460c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.636926 Jun 21 18:41:24.907509 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 466/931] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:24 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:41:25.945412 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-326322f6-e9f9-4afd-a5ba-f40e55b65da7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:25.947562 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-326322f6-e9f9-4afd-a5ba-f40e55b65da7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:25.961087 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-326322f6-e9f9-4afd-a5ba-f40e55b65da7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:25.961855 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-326322f6-e9f9-4afd-a5ba-f40e55b65da7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:25.963212 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-326322f6-e9f9-4afd-a5ba-f40e55b65da7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:25.964003 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-326322f6-e9f9-4afd-a5ba-f40e55b65da7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:26.123185 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-cfc70aba-38d4-490a-871b-3306475a011c req-73c79048-c333-463e-ae24-b9a141457b6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aab1542-b7fd-4057-9da2-8bcef1265883", "name": "network-vif-plugged", "status": "completed", "tag": "c320e6d5-945e-46d1-b2a9-bf683bd75477"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:41:26.129788 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:41:26.137198 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-cfc70aba-38d4-490a-871b-3306475a011c req-73c79048-c333-463e-ae24-b9a141457b6e service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:26.137753 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-cfc70aba-38d4-490a-871b-3306475a011c req-73c79048-c333-463e-ae24-b9a141457b6e service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:26.151564 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-cfc70aba-38d4-490a-871b-3306475a011c req-73c79048-c333-463e-ae24-b9a141457b6e service nova] Creating event network-vif-plugged:c320e6d5-945e-46d1-b2a9-bf683bd75477 for instance 4aab1542-b7fd-4057-9da2-8bcef1265883 on hv-cinder-84460 Jun 21 18:41:26.157323 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-cfc70aba-38d4-490a-871b-3306475a011c req-73c79048-c333-463e-ae24-b9a141457b6e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157460 Jun 21 18:41:26.158253 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 467/932] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:41:26.268019 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-326322f6-e9f9-4afd-a5ba-f40e55b65da7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:26.285203 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-326322f6-e9f9-4afd-a5ba-f40e55b65da7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:26.288744 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-326322f6-e9f9-4afd-a5ba-f40e55b65da7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:26.290252 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-326322f6-e9f9-4afd-a5ba-f40e55b65da7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.354293 Jun 21 18:41:26.291894 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 466/933] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:25 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:41:27.317699 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-afea405b-09df-480a-b58d-84daa8d0dc19 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:27.318474 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-afea405b-09df-480a-b58d-84daa8d0dc19 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:27.333163 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-afea405b-09df-480a-b58d-84daa8d0dc19 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:27.333976 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-afea405b-09df-480a-b58d-84daa8d0dc19 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:27.335363 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-afea405b-09df-480a-b58d-84daa8d0dc19 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:27.336110 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-afea405b-09df-480a-b58d-84daa8d0dc19 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:27.925537 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-afea405b-09df-480a-b58d-84daa8d0dc19 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:27.935898 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-afea405b-09df-480a-b58d-84daa8d0dc19 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:27.937385 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-afea405b-09df-480a-b58d-84daa8d0dc19 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:27.938595 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-afea405b-09df-480a-b58d-84daa8d0dc19 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.629873 Jun 21 18:41:27.939145 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 468/934] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:27 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:41:28.963179 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-222998cd-f0c0-488e-8c26-6ae4adb3060f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:28.970874 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-222998cd-f0c0-488e-8c26-6ae4adb3060f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:28.999640 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-222998cd-f0c0-488e-8c26-6ae4adb3060f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:29.000563 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-222998cd-f0c0-488e-8c26-6ae4adb3060f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:29.002213 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-222998cd-f0c0-488e-8c26-6ae4adb3060f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:29.004663 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-222998cd-f0c0-488e-8c26-6ae4adb3060f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:29.536505 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-222998cd-f0c0-488e-8c26-6ae4adb3060f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:29.553885 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-222998cd-f0c0-488e-8c26-6ae4adb3060f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:29.563305 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-222998cd-f0c0-488e-8c26-6ae4adb3060f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:29.564601 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-222998cd-f0c0-488e-8c26-6ae4adb3060f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1808 microversion: 2.20 time: 0.605644 Jun 21 18:41:29.578799 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 467/935] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:28 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1808 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:41:30.597255 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-86f528ac-0787-455c-b60f-9a9bedde0936 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:41:30.598212 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-86f528ac-0787-455c-b60f-9a9bedde0936 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:41:30.609302 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-86f528ac-0787-455c-b60f-9a9bedde0936 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:30.610003 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-86f528ac-0787-455c-b60f-9a9bedde0936 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:30.611255 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-86f528ac-0787-455c-b60f-9a9bedde0936 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:41:30.612093 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-86f528ac-0787-455c-b60f-9a9bedde0936 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:41:30.840259 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-86f528ac-0787-455c-b60f-9a9bedde0936 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:30.867442 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-86f528ac-0787-455c-b60f-9a9bedde0936 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:30.870566 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-86f528ac-0787-455c-b60f-9a9bedde0936 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:41:30.872886 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-86f528ac-0787-455c-b60f-9a9bedde0936 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1795 microversion: 2.20 time: 0.282751 Jun 21 18:41:30.874035 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 469/936] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:41:30 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1795 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:42:00.253545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:42:00.254401 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Tue Jun 21 18:42:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:42:47.076102 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=9 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:42:47.077683 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=78 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:42:47.405984 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-653cb32c-6501-432b-81c3-9d070c608ed5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Action: 'create', calling method: .version_select at 0x7fd8b2eed040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-198007524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0in6XVhG2vQAugSCWNzZ7qf86E9c7imfv/hfKNhFfEXoH0fzEHOHLfNquz/g1YKqAYsGqB/+65p2+zBvOr7yq0Y9SL2cqUtzBRiE1nvv1iGI6bMf4krC7/A2SuhhyCpg=="}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:42:47.432056 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-653cb32c-6501-432b-81c3-9d070c608ed5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Getting quotas for project 88c0ee0e3bda4c9b98c295af8718eff6. Resources: {'key_pairs'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:42:47.439787 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-653cb32c-6501-432b-81c3-9d070c608ed5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Getting quotas for user 0628da68245a42e4af2e16e42babc15a and project 88c0ee0e3bda4c9b98c295af8718eff6. Resources: {'key_pairs'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:42:47.485223 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-653cb32c-6501-432b-81c3-9d070c608ed5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.410491 Jun 21 18:42:47.497948 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 468/937] 10.222.0.87 () {60 vars in 1158 bytes} [Tue Jun 21 18:42:47 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:42:59.560131 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=5 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:42:59.561092 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=18 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:42:59.885693 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e17dda06-310b-4edf-9cc2-78b22d2f32bb tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Action: 'create', calling method: .version_select at 0x7fd8b83830d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-947960101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/ZF5N4TcsJSpNv5YWJB3+d1+6KwQBQbDsW/bAPz6BRXw7cqzzCe2TtwROMDaBcT6hwOBLOKqmcnyQge0z4PagV/mJfO0Fs7+2Wp71S4zbYTWAtvpreWLD9orZsE07xow=="}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:42:59.898219 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-e17dda06-310b-4edf-9cc2-78b22d2f32bb tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Getting quotas for project 990014bc19574d66ae5faae5c0751d5c. Resources: {'key_pairs'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:42:59.911522 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-e17dda06-310b-4edf-9cc2-78b22d2f32bb tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Getting quotas for user ea95ad1fabb74ba692aa9172128035eb and project 990014bc19574d66ae5faae5c0751d5c. Resources: {'key_pairs'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:42:59.957059 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e17dda06-310b-4edf-9cc2-78b22d2f32bb tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.398607 Jun 21 18:42:59.958496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 470/938] 10.222.0.87 () {60 vars in 1158 bytes} [Tue Jun 21 18:42:59 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:43:04.320348 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=4 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:04.321500 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:04.330745 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-da267d2f-59e6-4f28-8455-06793f09a763 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:04.331936 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-da267d2f-59e6-4f28-8455-06793f09a763 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:04.353506 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-da267d2f-59e6-4f28-8455-06793f09a763 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:04.354078 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-da267d2f-59e6-4f28-8455-06793f09a763 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:04.366472 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-da267d2f-59e6-4f28-8455-06793f09a763 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:04.367057 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-da267d2f-59e6-4f28-8455-06793f09a763 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:04.413260 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-da267d2f-59e6-4f28-8455-06793f09a763 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/os-volume_attachments/dad2d0ec-13cd-4d91-a19f-3bbd6fdebcfb" status: 200 len: 194 microversion: 2.20 time: 0.095904 Jun 21 18:43:04.413905 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 469/939] 10.222.0.87 () {60 vars in 1453 bytes} [Tue Jun 21 18:43:04 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/os-volume_attachments/dad2d0ec-13cd-4d91-a19f-3bbd6fdebcfb => generated 194 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:43:04.510044 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-281bf16d-2c87-43a9-9d0b-3c00ed36b65f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:04.510797 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-281bf16d-2c87-43a9-9d0b-3c00ed36b65f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:04.517399 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-281bf16d-2c87-43a9-9d0b-3c00ed36b65f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:04.517982 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-281bf16d-2c87-43a9-9d0b-3c00ed36b65f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:04.519620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-281bf16d-2c87-43a9-9d0b-3c00ed36b65f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:04.520418 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-281bf16d-2c87-43a9-9d0b-3c00ed36b65f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:04.628151 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.objects.instance [None req-281bf16d-2c87-43a9-9d0b-3c00ed36b65f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lazy-loading 'services' on Instance uuid 4aab1542-b7fd-4057-9da2-8bcef1265883 {{(pid=118109) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:43:04.764989 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-281bf16d-2c87-43a9-9d0b-3c00ed36b65f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "DELETE /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/os-volume_attachments/dad2d0ec-13cd-4d91-a19f-3bbd6fdebcfb" status: 202 len: 0 microversion: 2.20 time: 0.265507 Jun 21 18:43:04.767074 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 471/940] 10.222.0.87 () {60 vars in 1456 bytes} [Tue Jun 21 18:43:04 2022] DELETE /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/os-volume_attachments/dad2d0ec-13cd-4d91-a19f-3bbd6fdebcfb => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 21 18:43:04.783451 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b7a2c988-3aaa-460b-b05e-c02546842dbc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:04.785578 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b7a2c988-3aaa-460b-b05e-c02546842dbc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:04.798607 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b7a2c988-3aaa-460b-b05e-c02546842dbc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:04.799818 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b7a2c988-3aaa-460b-b05e-c02546842dbc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:04.803608 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b7a2c988-3aaa-460b-b05e-c02546842dbc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:04.807023 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b7a2c988-3aaa-460b-b05e-c02546842dbc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:04.873849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b7a2c988-3aaa-460b-b05e-c02546842dbc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.097454 Jun 21 18:43:04.874416 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 470/941] 10.222.0.87 () {60 vars in 1342 bytes} [Tue Jun 21 18:43:04 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:43:05.888908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-fc087466-d62f-46d9-8140-225a1f3f2ef0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:05.899500 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-fc087466-d62f-46d9-8140-225a1f3f2ef0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:05.910876 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fc087466-d62f-46d9-8140-225a1f3f2ef0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:05.911711 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fc087466-d62f-46d9-8140-225a1f3f2ef0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:05.912792 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fc087466-d62f-46d9-8140-225a1f3f2ef0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:05.918103 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fc087466-d62f-46d9-8140-225a1f3f2ef0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:05.984767 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-fc087466-d62f-46d9-8140-225a1f3f2ef0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.100631 Jun 21 18:43:05.986166 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 472/942] 10.222.0.87 () {60 vars in 1342 bytes} [Tue Jun 21 18:43:05 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:43:07.002889 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e851abd0-8964-4a86-b032-b0055fd297ea tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:07.005451 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e851abd0-8964-4a86-b032-b0055fd297ea tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:07.017062 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e851abd0-8964-4a86-b032-b0055fd297ea tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:07.019327 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e851abd0-8964-4a86-b032-b0055fd297ea tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:07.021480 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e851abd0-8964-4a86-b032-b0055fd297ea tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:07.022574 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e851abd0-8964-4a86-b032-b0055fd297ea tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:07.066816 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e851abd0-8964-4a86-b032-b0055fd297ea tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.070170 Jun 21 18:43:07.067660 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 471/943] 10.222.0.87 () {60 vars in 1342 bytes} [Tue Jun 21 18:43:06 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:07.158313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1626e0e0-b9d3-459f-938e-f0e108c230c7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:07.159488 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1626e0e0-b9d3-459f-938e-f0e108c230c7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:07.167722 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1626e0e0-b9d3-459f-938e-f0e108c230c7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:07.168145 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1626e0e0-b9d3-459f-938e-f0e108c230c7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:07.169434 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1626e0e0-b9d3-459f-938e-f0e108c230c7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:07.170382 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1626e0e0-b9d3-459f-938e-f0e108c230c7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:07.214603 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1626e0e0-b9d3-459f-938e-f0e108c230c7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Going to try to terminate instance {{(pid=118109) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:43:07.330395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1626e0e0-b9d3-459f-938e-f0e108c230c7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "DELETE /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 204 len: 0 microversion: 2.20 time: 0.175560 Jun 21 18:43:07.330981 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 473/944] 10.222.0.87 () {60 vars in 1279 bytes} [Tue Jun 21 18:43:07 2022] DELETE /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 21 18:43:07.342525 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a4d56599-6de2-43cf-951d-27b6c24fe7f9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:07.343343 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-a4d56599-6de2-43cf-951d-27b6c24fe7f9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:07.353507 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a4d56599-6de2-43cf-951d-27b6c24fe7f9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:07.353999 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a4d56599-6de2-43cf-951d-27b6c24fe7f9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:07.354853 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a4d56599-6de2-43cf-951d-27b6c24fe7f9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:07.355294 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a4d56599-6de2-43cf-951d-27b6c24fe7f9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:07.551708 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-a4d56599-6de2-43cf-951d-27b6c24fe7f9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:07.561122 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-a4d56599-6de2-43cf-951d-27b6c24fe7f9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:07.562664 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-a4d56599-6de2-43cf-951d-27b6c24fe7f9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:07.563859 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a4d56599-6de2-43cf-951d-27b6c24fe7f9 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1723 microversion: 2.20 time: 0.226259 Jun 21 18:43:07.564407 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 472/945] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:43:07 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:43:08.586861 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-01f0a403-dfc4-4a42-b2f1-f1bdc0c92649 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:08.587567 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-01f0a403-dfc4-4a42-b2f1-f1bdc0c92649 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:08.594727 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-01f0a403-dfc4-4a42-b2f1-f1bdc0c92649 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:08.595193 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-01f0a403-dfc4-4a42-b2f1-f1bdc0c92649 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:08.595969 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-01f0a403-dfc4-4a42-b2f1-f1bdc0c92649 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:08.596430 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-01f0a403-dfc4-4a42-b2f1-f1bdc0c92649 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:08.769988 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-01f0a403-dfc4-4a42-b2f1-f1bdc0c92649 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:08.782378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-01f0a403-dfc4-4a42-b2f1-f1bdc0c92649 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:08.783929 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-01f0a403-dfc4-4a42-b2f1-f1bdc0c92649 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:08.785198 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-01f0a403-dfc4-4a42-b2f1-f1bdc0c92649 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1723 microversion: 2.20 time: 0.205165 Jun 21 18:43:08.786084 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 474/946] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:43:08 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:43:09.966056 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-90046d24-8954-4842-981c-c5996c770061 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:09.966673 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-90046d24-8954-4842-981c-c5996c770061 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:09.974424 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-90046d24-8954-4842-981c-c5996c770061 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:09.974964 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-90046d24-8954-4842-981c-c5996c770061 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:09.976245 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-90046d24-8954-4842-981c-c5996c770061 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:09.976679 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-90046d24-8954-4842-981c-c5996c770061 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:10.268887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-90046d24-8954-4842-981c-c5996c770061 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:10.278864 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-90046d24-8954-4842-981c-c5996c770061 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:10.280482 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-90046d24-8954-4842-981c-c5996c770061 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:10.281854 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-90046d24-8954-4842-981c-c5996c770061 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1723 microversion: 2.20 time: 0.481235 Jun 21 18:43:10.282385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 473/947] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:43:09 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1723 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:43:11.263471 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-f71ba236-8bb2-416d-82c7-6e5be7f4d973 req-ff7817e7-1cf2-4582-8e37-2c1cf5a2df65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aab1542-b7fd-4057-9da2-8bcef1265883", "name": "network-vif-deleted", "tag": "c320e6d5-945e-46d1-b2a9-bf683bd75477"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:43:11.270098 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=4 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:11.282987 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-f71ba236-8bb2-416d-82c7-6e5be7f4d973 req-ff7817e7-1cf2-4582-8e37-2c1cf5a2df65 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:11.284271 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-f71ba236-8bb2-416d-82c7-6e5be7f4d973 req-ff7817e7-1cf2-4582-8e37-2c1cf5a2df65 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:11.305101 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4115184f-0d9c-49a8-9f45-7c92e26953d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:11.306226 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4115184f-0d9c-49a8-9f45-7c92e26953d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:11.313600 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-f71ba236-8bb2-416d-82c7-6e5be7f4d973 req-ff7817e7-1cf2-4582-8e37-2c1cf5a2df65 service nova] Creating event network-vif-deleted:c320e6d5-945e-46d1-b2a9-bf683bd75477 for instance 4aab1542-b7fd-4057-9da2-8bcef1265883 on hv-cinder-84460 Jun 21 18:43:11.327391 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4115184f-0d9c-49a8-9f45-7c92e26953d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:11.328137 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4115184f-0d9c-49a8-9f45-7c92e26953d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:11.328642 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-f71ba236-8bb2-416d-82c7-6e5be7f4d973 req-ff7817e7-1cf2-4582-8e37-2c1cf5a2df65 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076957 Jun 21 18:43:11.329581 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4115184f-0d9c-49a8-9f45-7c92e26953d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:11.330423 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4115184f-0d9c-49a8-9f45-7c92e26953d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:11.334598 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 475/948] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:43:11.443625 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-4115184f-0d9c-49a8-9f45-7c92e26953d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:11.458138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-4115184f-0d9c-49a8-9f45-7c92e26953d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:11.460394 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-4115184f-0d9c-49a8-9f45-7c92e26953d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:11.461944 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4115184f-0d9c-49a8-9f45-7c92e26953d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 200 len: 1366 microversion: 2.20 time: 0.164455 Jun 21 18:43:11.473158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 474/949] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:43:11 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:43:12.482922 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-57883bde-5a32-4142-ba92-8f61c195fadb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:12.483631 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-57883bde-5a32-4142-ba92-8f61c195fadb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:12.493981 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-57883bde-5a32-4142-ba92-8f61c195fadb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:12.494553 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-57883bde-5a32-4142-ba92-8f61c195fadb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:12.495700 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-57883bde-5a32-4142-ba92-8f61c195fadb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:12.496279 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-57883bde-5a32-4142-ba92-8f61c195fadb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:12.521037 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-57883bde-5a32-4142-ba92-8f61c195fadb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] HTTP exception thrown: Instance 4aab1542-b7fd-4057-9da2-8bcef1265883 could not be found. Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-57883bde-5a32-4142-ba92-8f61c195fadb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Request method failure captured: Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 HTTP/1.1 Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABishARPnL_sqkJOwUwUdv-Kudej4fgBpNABEa3Xl8XXMR1YhBYstjm5v48DSgQXDvnu2OeMVyoWO0unkvh7GXepLvqWbp9OArS_Hi2NaxjZ5ZE-up7t9q0f5SFZk63sTZvjuwrCcY0elI9T7XxojEIr2uviMaB3trJFEziaWf_bkY9L1M Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 21a4c114c12d40abb896e2637ee6ab83 Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1134987768 Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:43:12.524853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:43:12.532399 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:43:12.532399 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1134987768 Jun 21 18:43:12.532399 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 21a4c114c12d40abb896e2637ee6ab83 Jun 21 18:43:12.532399 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1134987768 Jun 21 18:43:12.532399 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-AttachVolumeShelveTestJSON-1134987768-project Jun 21 18:43:12.532399 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:43:12.532399 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:43:12.532399 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: 93785710c10749f9aa3d29b43965909c Jun 21 18:43:12.532399 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1134987768-project Jun 21 18:43:12.532399 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:43:12.532399 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance 4aab1542-b7fd-4057-9da2-8bcef1265883 could not be found. Jun 21 18:43:12.532399 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': '4aab1542-b7fd-4057-9da2-8bcef1265883'} Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aab1542-b7fd-4057-9da2-8bcef1265883 could not be found. Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:43:12.533406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:43:12.535045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:43:12.535045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:43:12.535045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:43:12.535045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:43:12.535045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:43:12.535045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:43:12.535045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:43:12.535045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aab1542-b7fd-4057-9da2-8bcef1265883 could not be found. Jun 21 18:43:12.535045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:43:12.535045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:43:12.535045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:43:12.535045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:43:12.535045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:43:12.535045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:43:12.535045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:43:12.535045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:43:12.535045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aab1542-b7fd-4057-9da2-8bcef1265883 could not be found. Jun 21 18:43:12.535045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:43:12.536524 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-57883bde-5a32-4142-ba92-8f61c195fadb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Returning 404 to user: Instance 4aab1542-b7fd-4057-9da2-8bcef1265883 could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:43:12.536524 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-57883bde-5a32-4142-ba92-8f61c195fadb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 404 len: 111 microversion: 2.20 time: 0.048747 Jun 21 18:43:12.536524 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 476/950] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:43:12 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 18:43:12.541972 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-68e53cf2-c703-404e-b5c6-fa72b06c094d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '.version_select at 0x7fd8b2e83a60>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:12.577935 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-68e53cf2-c703-404e-b5c6-fa72b06c094d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746252391" status: 204 len: 0 microversion: 2.20 time: 0.043829 Jun 21 18:43:12.578560 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 475/951] 10.222.0.87 () {60 vars in 1261 bytes} [Tue Jun 21 18:43:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746252391 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 18:43:13.547411 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-dc6ac7c9-5609-4808-8931-e8a8dff8541a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Action: 'create', calling method: .version_select at 0x7fd8b8173d30>, body: {"keypair": {"name": "tempest-keypair-550487554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpNMt/oVKC4jmCgJcKK5DbAI3aO3IfsxY65QkdhB3UhuANoRXmPlCnTCjnUaKfMeDSuPY7AR4ky8JoJoQIrDc/sJKdp8CmEstyXqWLDSd1vXbgcTWfbXzEJ/vul/M+8lA=="}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:43:13.564511 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-dc6ac7c9-5609-4808-8931-e8a8dff8541a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Getting quotas for project 21a4c114c12d40abb896e2637ee6ab83. Resources: {'key_pairs'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:43:13.570113 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-dc6ac7c9-5609-4808-8931-e8a8dff8541a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Getting quotas for user 93785710c10749f9aa3d29b43965909c and project 21a4c114c12d40abb896e2637ee6ab83. Resources: {'key_pairs'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:43:13.611944 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-dc6ac7c9-5609-4808-8931-e8a8dff8541a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.069375 Jun 21 18:43:13.612587 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 477/952] 10.222.0.87 () {62 vars in 1199 bytes} [Tue Jun 21 18:43:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 71 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 21 18:43:14.568688 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-7fd937da-ebab-4286-b720-8abedf8d3757 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1423790046", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-198007524", "security_groups": [{"name": "tempest-secgroup-smoke-179192695"}], "block_device_mapping_v2": [{"uuid": "4e15c809-5127-45be-9abf-663daa3e58eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a330634b-a2bf-4221-a2b7-6d2504bd49e4"}]}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:43:14.736499 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.network.neutron [None req-7fd937da-ebab-4286-b720-8abedf8d3757 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] validate_networks() for [('a330634b-a2bf-4221-a2b7-6d2504bd49e4', None, None, None, None, None)] {{(pid=118108) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:43:15.474328 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-956b22cd-a25b-424c-882b-6cf3d0c3e373 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1272878129", "imageRef": "c28659fb-c2d3-4dda-a330-1323a974987e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "154818ed-45dc-4361-88eb-8c702043f742"}], "security_groups": [{"name": "tempest-securitygroup--213445232"}], "key_name": "tempest-keypair-550487554", "user_data": "}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:43:15.488179 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-7fd937da-ebab-4286-b720-8abedf8d3757 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Flavor limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:43:15.489355 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-7fd937da-ebab-4286-b720-8abedf8d3757 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Image limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:43:15.490395 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-7fd937da-ebab-4286-b720-8abedf8d3757 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Flavor pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:43:15.490968 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-7fd937da-ebab-4286-b720-8abedf8d3757 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Image pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:43:15.491421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-7fd937da-ebab-4286-b720-8abedf8d3757 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:43:15.506177 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7fd937da-ebab-4286-b720-8abedf8d3757 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:15.506914 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7fd937da-ebab-4286-b720-8abedf8d3757 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:15.508263 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7fd937da-ebab-4286-b720-8abedf8d3757 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:15.509025 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7fd937da-ebab-4286-b720-8abedf8d3757 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:15.538357 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-7fd937da-ebab-4286-b720-8abedf8d3757 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Getting quotas for project 88c0ee0e3bda4c9b98c295af8718eff6. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:43:15.546769 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-7fd937da-ebab-4286-b720-8abedf8d3757 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Getting quotas for user 0628da68245a42e4af2e16e42babc15a and project 88c0ee0e3bda4c9b98c295af8718eff6. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:43:15.613338 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.network.neutron [None req-956b22cd-a25b-424c-882b-6cf3d0c3e373 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] validate_networks() for [('154818ed-45dc-4361-88eb-8c702043f742', None, None, None, None, None)] {{(pid=118109) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:43:15.632252 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-7fd937da-ebab-4286-b720-8abedf8d3757 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Going to run 1 instances... {{(pid=118108) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:43:15.634409 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-7fd937da-ebab-4286-b720-8abedf8d3757 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4e15c809-5127-45be-9abf-663daa3e58eb',volume_size=None,volume_type=None)] {{(pid=118108) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:43:15.813873 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-7fd937da-ebab-4286-b720-8abedf8d3757 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.251741 Jun 21 18:43:15.823503 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 476/953] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:43:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:43:15.829410 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-7488d436-00db-4930-83c9-1aa7c6290d73 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:15.830157 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-7488d436-00db-4930-83c9-1aa7c6290d73 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:15.905755 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-7488d436-00db-4930-83c9-1aa7c6290d73 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:15.913669 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-7488d436-00db-4930-83c9-1aa7c6290d73 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1094 microversion: 2.1 time: 0.088531 Jun 21 18:43:15.914510 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 477/954] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:15 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1094 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:16.288920 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-956b22cd-a25b-424c-882b-6cf3d0c3e373 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Flavor limits 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:43:16.289343 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-956b22cd-a25b-424c-882b-6cf3d0c3e373 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Image limits 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:43:16.290122 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-956b22cd-a25b-424c-882b-6cf3d0c3e373 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Flavor pref 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:43:16.290538 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-956b22cd-a25b-424c-882b-6cf3d0c3e373 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Image pref 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:43:16.291120 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-956b22cd-a25b-424c-882b-6cf3d0c3e373 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:43:16.308513 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-956b22cd-a25b-424c-882b-6cf3d0c3e373 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:16.309545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-956b22cd-a25b-424c-882b-6cf3d0c3e373 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:16.310661 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-956b22cd-a25b-424c-882b-6cf3d0c3e373 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:16.311290 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-956b22cd-a25b-424c-882b-6cf3d0c3e373 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:16.340332 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-956b22cd-a25b-424c-882b-6cf3d0c3e373 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Getting quotas for project 21a4c114c12d40abb896e2637ee6ab83. Resources: {'instances', 'ram', 'cores'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:43:16.346993 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-956b22cd-a25b-424c-882b-6cf3d0c3e373 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Getting quotas for user 93785710c10749f9aa3d29b43965909c and project 21a4c114c12d40abb896e2637ee6ab83. Resources: {'instances', 'ram', 'cores'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:43:16.369500 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-956b22cd-a25b-424c-882b-6cf3d0c3e373 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Going to run 1 instances... {{(pid=118109) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:43:16.372041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-956b22cd-a25b-424c-882b-6cf3d0c3e373 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c28659fb-c2d3-4dda-a330-1323a974987e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118109) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:43:16.460224 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-956b22cd-a25b-424c-882b-6cf3d0c3e373 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.995936 Jun 21 18:43:16.469895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 478/955] 10.222.0.87 () {62 vars in 1187 bytes} [Tue Jun 21 18:43:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 21 18:43:16.477825 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-516fff00-c1d3-4a01-8860-7c478a1862d8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:16.481485 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-516fff00-c1d3-4a01-8860-7c478a1862d8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:16.582027 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-516fff00-c1d3-4a01-8860-7c478a1862d8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:16.598781 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-516fff00-c1d3-4a01-8860-7c478a1862d8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:16.601768 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-516fff00-c1d3-4a01-8860-7c478a1862d8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:16.603944 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-516fff00-c1d3-4a01-8860-7c478a1862d8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1281 microversion: 2.20 time: 0.131393 Jun 21 18:43:16.604932 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 478/956] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:43:16 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1281 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:43:16.935069 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ff8b8896-a059-4b39-bb77-d9c2a74afc9b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:16.936201 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ff8b8896-a059-4b39-bb77-d9c2a74afc9b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:16.944871 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ff8b8896-a059-4b39-bb77-d9c2a74afc9b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:16.945597 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ff8b8896-a059-4b39-bb77-d9c2a74afc9b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:16.948176 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ff8b8896-a059-4b39-bb77-d9c2a74afc9b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:16.948176 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ff8b8896-a059-4b39-bb77-d9c2a74afc9b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:17.050420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ff8b8896-a059-4b39-bb77-d9c2a74afc9b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:17.075056 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ff8b8896-a059-4b39-bb77-d9c2a74afc9b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1192 microversion: 2.1 time: 0.144613 Jun 21 18:43:17.076750 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 479/957] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:16 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1192 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:17.627026 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-685e6a10-9fe8-446d-beac-d6fd7bc187bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:17.627887 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-685e6a10-9fe8-446d-beac-d6fd7bc187bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:17.637249 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-685e6a10-9fe8-446d-beac-d6fd7bc187bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:17.637596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-685e6a10-9fe8-446d-beac-d6fd7bc187bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:17.638465 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-685e6a10-9fe8-446d-beac-d6fd7bc187bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:17.638976 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-685e6a10-9fe8-446d-beac-d6fd7bc187bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:17.750222 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-685e6a10-9fe8-446d-beac-d6fd7bc187bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:17.762721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-685e6a10-9fe8-446d-beac-d6fd7bc187bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:17.764676 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-685e6a10-9fe8-446d-beac-d6fd7bc187bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:17.766432 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-685e6a10-9fe8-446d-beac-d6fd7bc187bc tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1333 microversion: 2.20 time: 0.144521 Jun 21 18:43:17.767175 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 479/958] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:43:17 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1333 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:43:18.103612 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b93da38b-f315-417c-b43a-8a898a6baf1f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:18.105165 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b93da38b-f315-417c-b43a-8a898a6baf1f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:18.114358 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b93da38b-f315-417c-b43a-8a898a6baf1f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:18.114980 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b93da38b-f315-417c-b43a-8a898a6baf1f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:18.115918 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b93da38b-f315-417c-b43a-8a898a6baf1f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:18.116552 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b93da38b-f315-417c-b43a-8a898a6baf1f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:18.374828 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b93da38b-f315-417c-b43a-8a898a6baf1f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:18.383976 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b93da38b-f315-417c-b43a-8a898a6baf1f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1277 microversion: 2.1 time: 0.285019 Jun 21 18:43:18.384970 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 480/959] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:18 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1277 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:18.789388 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-253ee481-a804-454a-b528-a96f5afa8c11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:18.790921 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-253ee481-a804-454a-b528-a96f5afa8c11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:18.805885 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-253ee481-a804-454a-b528-a96f5afa8c11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:18.807067 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-253ee481-a804-454a-b528-a96f5afa8c11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:18.808171 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-253ee481-a804-454a-b528-a96f5afa8c11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:18.809079 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-253ee481-a804-454a-b528-a96f5afa8c11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:19.088435 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-253ee481-a804-454a-b528-a96f5afa8c11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:19.101618 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-253ee481-a804-454a-b528-a96f5afa8c11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:19.103370 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-253ee481-a804-454a-b528-a96f5afa8c11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:19.104625 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-253ee481-a804-454a-b528-a96f5afa8c11 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1406 microversion: 2.20 time: 0.321821 Jun 21 18:43:19.111672 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 480/960] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:43:18 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:43:19.323059 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-7f5ab6b9-e3d9-417a-91f0-d3e1453bcb83 req-d36d602d-0efa-402e-b9aa-3386dc112a43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7d8e4d2-7b70-415b-a82b-e217d55cef26", "tag": "7554a426-600d-477b-9a71-f583c2065650"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:43:19.344524 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-7f5ab6b9-e3d9-417a-91f0-d3e1453bcb83 req-d36d602d-0efa-402e-b9aa-3386dc112a43 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:19.358468 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-7f5ab6b9-e3d9-417a-91f0-d3e1453bcb83 req-d36d602d-0efa-402e-b9aa-3386dc112a43 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:19.385062 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-7f5ab6b9-e3d9-417a-91f0-d3e1453bcb83 req-d36d602d-0efa-402e-b9aa-3386dc112a43 service nova] Creating event network-changed:7554a426-600d-477b-9a71-f583c2065650 for instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 on hv-cinder-84460 Jun 21 18:43:19.390908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-7f5ab6b9-e3d9-417a-91f0-d3e1453bcb83 req-d36d602d-0efa-402e-b9aa-3386dc112a43 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071766 Jun 21 18:43:19.391801 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 481/961] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:43:19.404075 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-73d9e2ce-7aec-4fa0-9831-08be4ad8a8b0 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:19.404705 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-73d9e2ce-7aec-4fa0-9831-08be4ad8a8b0 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:19.411794 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-73d9e2ce-7aec-4fa0-9831-08be4ad8a8b0 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:19.412405 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-73d9e2ce-7aec-4fa0-9831-08be4ad8a8b0 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:19.413214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-73d9e2ce-7aec-4fa0-9831-08be4ad8a8b0 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:19.413672 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-73d9e2ce-7aec-4fa0-9831-08be4ad8a8b0 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:19.713629 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-73d9e2ce-7aec-4fa0-9831-08be4ad8a8b0 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:19.726363 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-73d9e2ce-7aec-4fa0-9831-08be4ad8a8b0 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1265 microversion: 2.1 time: 0.326211 Jun 21 18:43:19.739687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 481/962] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:19 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1265 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:20.025745 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-04c72ecb-67b3-4bb5-b196-f547a9f9b50b req-2dc671ba-48e9-49a7-81ba-4e068ff8c93c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ba08486-1cfb-443b-9e39-ba65962dd01e", "tag": "bffcf1ea-ece3-4130-9438-75fbde5fa0bf"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:43:20.036770 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-04c72ecb-67b3-4bb5-b196-f547a9f9b50b req-2dc671ba-48e9-49a7-81ba-4e068ff8c93c service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:20.037233 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-04c72ecb-67b3-4bb5-b196-f547a9f9b50b req-2dc671ba-48e9-49a7-81ba-4e068ff8c93c service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:20.052112 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-04c72ecb-67b3-4bb5-b196-f547a9f9b50b req-2dc671ba-48e9-49a7-81ba-4e068ff8c93c service nova] Creating event network-changed:bffcf1ea-ece3-4130-9438-75fbde5fa0bf for instance 2ba08486-1cfb-443b-9e39-ba65962dd01e on hv-cinder-84460 Jun 21 18:43:20.058210 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-04c72ecb-67b3-4bb5-b196-f547a9f9b50b req-2dc671ba-48e9-49a7-81ba-4e068ff8c93c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172714 Jun 21 18:43:20.059187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 482/963] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:43:20.128548 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-dfbc7a4c-1bbd-47ec-94d5-273e2cc45412 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:20.129968 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-dfbc7a4c-1bbd-47ec-94d5-273e2cc45412 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:20.137955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dfbc7a4c-1bbd-47ec-94d5-273e2cc45412 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:20.139086 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dfbc7a4c-1bbd-47ec-94d5-273e2cc45412 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:20.140788 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dfbc7a4c-1bbd-47ec-94d5-273e2cc45412 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:20.141940 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dfbc7a4c-1bbd-47ec-94d5-273e2cc45412 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:20.392349 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-dfbc7a4c-1bbd-47ec-94d5-273e2cc45412 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:20.408344 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-dfbc7a4c-1bbd-47ec-94d5-273e2cc45412 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:20.411883 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-dfbc7a4c-1bbd-47ec-94d5-273e2cc45412 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:20.414613 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-dfbc7a4c-1bbd-47ec-94d5-273e2cc45412 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1406 microversion: 2.20 time: 0.289800 Jun 21 18:43:20.416027 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 482/964] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:43:20 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:43:20.746920 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-6c37d8cd-52cf-4e2f-8d8f-ceec7728d474 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:20.747740 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-6c37d8cd-52cf-4e2f-8d8f-ceec7728d474 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:20.754888 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6c37d8cd-52cf-4e2f-8d8f-ceec7728d474 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:20.755374 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6c37d8cd-52cf-4e2f-8d8f-ceec7728d474 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:20.756286 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6c37d8cd-52cf-4e2f-8d8f-ceec7728d474 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:20.756721 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-6c37d8cd-52cf-4e2f-8d8f-ceec7728d474 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:20.920377 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-6c37d8cd-52cf-4e2f-8d8f-ceec7728d474 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:20.930898 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-6c37d8cd-52cf-4e2f-8d8f-ceec7728d474 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1265 microversion: 2.1 time: 0.188073 Jun 21 18:43:20.931540 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 483/965] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:20 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:21.439534 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c28e0b05-2ccd-471a-8ec9-e042178d803d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:21.440147 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c28e0b05-2ccd-471a-8ec9-e042178d803d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:21.447549 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c28e0b05-2ccd-471a-8ec9-e042178d803d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:21.448006 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c28e0b05-2ccd-471a-8ec9-e042178d803d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:21.448795 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c28e0b05-2ccd-471a-8ec9-e042178d803d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:21.449233 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c28e0b05-2ccd-471a-8ec9-e042178d803d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:21.642338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c28e0b05-2ccd-471a-8ec9-e042178d803d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:21.652466 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c28e0b05-2ccd-471a-8ec9-e042178d803d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:21.654015 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c28e0b05-2ccd-471a-8ec9-e042178d803d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:21.655177 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c28e0b05-2ccd-471a-8ec9-e042178d803d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1406 microversion: 2.20 time: 0.219693 Jun 21 18:43:21.655749 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 483/966] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:43:21 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:43:21.948744 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-4137cf59-6880-4b78-9f75-e0c508b5b20d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:21.949369 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-4137cf59-6880-4b78-9f75-e0c508b5b20d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:21.957141 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4137cf59-6880-4b78-9f75-e0c508b5b20d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:21.957893 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4137cf59-6880-4b78-9f75-e0c508b5b20d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:21.958752 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4137cf59-6880-4b78-9f75-e0c508b5b20d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:21.959211 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4137cf59-6880-4b78-9f75-e0c508b5b20d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:22.109436 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-4137cf59-6880-4b78-9f75-e0c508b5b20d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:22.118321 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-4137cf59-6880-4b78-9f75-e0c508b5b20d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1265 microversion: 2.1 time: 0.173431 Jun 21 18:43:22.118874 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 484/967] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:21 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:22.681607 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6f557e6a-db8c-419e-9c78-d4f5de0dba15 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:22.682291 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-6f557e6a-db8c-419e-9c78-d4f5de0dba15 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:22.689026 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6f557e6a-db8c-419e-9c78-d4f5de0dba15 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:22.689471 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6f557e6a-db8c-419e-9c78-d4f5de0dba15 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:22.690317 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6f557e6a-db8c-419e-9c78-d4f5de0dba15 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:22.690745 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6f557e6a-db8c-419e-9c78-d4f5de0dba15 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:22.840464 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6f557e6a-db8c-419e-9c78-d4f5de0dba15 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:22.851249 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6f557e6a-db8c-419e-9c78-d4f5de0dba15 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:22.853567 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6f557e6a-db8c-419e-9c78-d4f5de0dba15 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:22.854843 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6f557e6a-db8c-419e-9c78-d4f5de0dba15 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1406 microversion: 2.20 time: 0.178119 Jun 21 18:43:22.855422 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 484/968] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:43:22 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:43:23.136142 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-fffb9bb1-282a-4f6c-8568-879498e30f56 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:23.136803 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-fffb9bb1-282a-4f6c-8568-879498e30f56 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:23.144059 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fffb9bb1-282a-4f6c-8568-879498e30f56 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:23.144467 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fffb9bb1-282a-4f6c-8568-879498e30f56 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:23.145253 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fffb9bb1-282a-4f6c-8568-879498e30f56 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:23.145908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fffb9bb1-282a-4f6c-8568-879498e30f56 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:23.315951 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-fffb9bb1-282a-4f6c-8568-879498e30f56 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:23.326115 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-fffb9bb1-282a-4f6c-8568-879498e30f56 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1265 microversion: 2.1 time: 0.194113 Jun 21 18:43:23.326706 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 485/969] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:23 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:23.876921 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-362a53cb-2a76-423e-9f13-096f32d4b418 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:23.877518 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-362a53cb-2a76-423e-9f13-096f32d4b418 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:23.885051 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-362a53cb-2a76-423e-9f13-096f32d4b418 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:23.885895 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-362a53cb-2a76-423e-9f13-096f32d4b418 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:23.887280 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-362a53cb-2a76-423e-9f13-096f32d4b418 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:23.888056 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-362a53cb-2a76-423e-9f13-096f32d4b418 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:24.055056 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-362a53cb-2a76-423e-9f13-096f32d4b418 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:24.064124 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-362a53cb-2a76-423e-9f13-096f32d4b418 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:24.065663 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-362a53cb-2a76-423e-9f13-096f32d4b418 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:24.067199 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-362a53cb-2a76-423e-9f13-096f32d4b418 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1406 microversion: 2.20 time: 0.194263 Jun 21 18:43:24.067465 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 485/970] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:43:23 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:43:24.347285 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-98de8272-0415-43af-ad88-b67e112934da tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:24.348528 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-98de8272-0415-43af-ad88-b67e112934da tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:24.356827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-98de8272-0415-43af-ad88-b67e112934da tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:24.357279 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-98de8272-0415-43af-ad88-b67e112934da tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:24.358139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-98de8272-0415-43af-ad88-b67e112934da tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:24.358733 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-98de8272-0415-43af-ad88-b67e112934da tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:24.553672 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-98de8272-0415-43af-ad88-b67e112934da tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:24.562651 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-98de8272-0415-43af-ad88-b67e112934da tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1265 microversion: 2.1 time: 0.219816 Jun 21 18:43:24.563241 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 486/971] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:24 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:25.087945 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e7d9589a-0fc8-4dd6-8264-fbfec7aeb5b1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:25.088632 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e7d9589a-0fc8-4dd6-8264-fbfec7aeb5b1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:25.096122 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e7d9589a-0fc8-4dd6-8264-fbfec7aeb5b1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:25.096572 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e7d9589a-0fc8-4dd6-8264-fbfec7aeb5b1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:25.097542 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e7d9589a-0fc8-4dd6-8264-fbfec7aeb5b1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:25.097946 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e7d9589a-0fc8-4dd6-8264-fbfec7aeb5b1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:25.253297 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e7d9589a-0fc8-4dd6-8264-fbfec7aeb5b1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:25.263410 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e7d9589a-0fc8-4dd6-8264-fbfec7aeb5b1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:25.264998 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e7d9589a-0fc8-4dd6-8264-fbfec7aeb5b1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:25.266221 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e7d9589a-0fc8-4dd6-8264-fbfec7aeb5b1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1406 microversion: 2.20 time: 0.183351 Jun 21 18:43:25.266763 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 486/972] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:43:25 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:43:25.581455 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-58f48010-4d47-4b8e-afd5-bd8a55903805 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:25.583638 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-58f48010-4d47-4b8e-afd5-bd8a55903805 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:25.592512 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-58f48010-4d47-4b8e-afd5-bd8a55903805 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:25.593157 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-58f48010-4d47-4b8e-afd5-bd8a55903805 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:25.593998 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-58f48010-4d47-4b8e-afd5-bd8a55903805 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:25.594440 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-58f48010-4d47-4b8e-afd5-bd8a55903805 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:25.814846 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-fd7bc025-0d54-42eb-b854-00ea81383c6b tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2132010267", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-947960101", "security_groups": [{"name": "tempest-secgroup-smoke-1914311527"}], "networks": [{"uuid": "a8491f15-d369-4779-b0fe-27485399698d"}], "block_device_mapping_v2": [{"uuid": "5fb625d5-348c-4617-baaa-b74dda4a0a77", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:43:25.829891 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=2 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:26.102836 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.network.neutron [None req-fd7bc025-0d54-42eb-b854-00ea81383c6b tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] validate_networks() for [('a8491f15-d369-4779-b0fe-27485399698d', None, None, None, None, None)] {{(pid=118108) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:43:26.231474 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-58f48010-4d47-4b8e-afd5-bd8a55903805 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:26.240643 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-58f48010-4d47-4b8e-afd5-bd8a55903805 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1265 microversion: 2.1 time: 0.663543 Jun 21 18:43:26.241233 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 487/973] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:25 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1265 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:43:26.287296 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-33e67fdf-120b-4d79-ae9a-3719ba9e9644 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:26.290777 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-33e67fdf-120b-4d79-ae9a-3719ba9e9644 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:26.299462 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-33e67fdf-120b-4d79-ae9a-3719ba9e9644 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:26.299938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-33e67fdf-120b-4d79-ae9a-3719ba9e9644 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:26.300749 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-33e67fdf-120b-4d79-ae9a-3719ba9e9644 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:26.301714 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-33e67fdf-120b-4d79-ae9a-3719ba9e9644 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:26.325763 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=2 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:26.359771 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=10 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:26.592537 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=10 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:26.732567 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-33e67fdf-120b-4d79-ae9a-3719ba9e9644 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:26.757318 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-33e67fdf-120b-4d79-ae9a-3719ba9e9644 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:26.761541 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-33e67fdf-120b-4d79-ae9a-3719ba9e9644 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:26.764358 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-33e67fdf-120b-4d79-ae9a-3719ba9e9644 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1406 microversion: 2.20 time: 0.481690 Jun 21 18:43:26.765514 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 488/974] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:43:26 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1406 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:43:26.776665 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-42aed512-332a-4354-b007-755642edd38e req-09659ffe-4141-4b4e-8177-3434a9c933ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba08486-1cfb-443b-9e39-ba65962dd01e", "name": "network-vif-plugged", "status": "completed", "tag": "bffcf1ea-ece3-4130-9438-75fbde5fa0bf"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:43:26.791915 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-42aed512-332a-4354-b007-755642edd38e req-09659ffe-4141-4b4e-8177-3434a9c933ef service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:26.792393 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-42aed512-332a-4354-b007-755642edd38e req-09659ffe-4141-4b4e-8177-3434a9c933ef service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:26.817418 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-42aed512-332a-4354-b007-755642edd38e req-09659ffe-4141-4b4e-8177-3434a9c933ef service nova] Creating event network-vif-plugged:bffcf1ea-ece3-4130-9438-75fbde5fa0bf for instance 2ba08486-1cfb-443b-9e39-ba65962dd01e on hv-cinder-84460 Jun 21 18:43:26.829174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-42aed512-332a-4354-b007-755642edd38e req-09659ffe-4141-4b4e-8177-3434a9c933ef service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060647 Jun 21 18:43:26.834017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 489/975] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:43:27.134159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-fd7bc025-0d54-42eb-b854-00ea81383c6b tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Flavor limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:43:27.135143 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-fd7bc025-0d54-42eb-b854-00ea81383c6b tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Image limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:43:27.136019 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-fd7bc025-0d54-42eb-b854-00ea81383c6b tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Flavor pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:43:27.136702 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-fd7bc025-0d54-42eb-b854-00ea81383c6b tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Image pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:43:27.137443 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-fd7bc025-0d54-42eb-b854-00ea81383c6b tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:43:27.149678 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fd7bc025-0d54-42eb-b854-00ea81383c6b tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:27.150149 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fd7bc025-0d54-42eb-b854-00ea81383c6b tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:27.150967 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fd7bc025-0d54-42eb-b854-00ea81383c6b tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:27.151416 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fd7bc025-0d54-42eb-b854-00ea81383c6b tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:27.171825 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-fd7bc025-0d54-42eb-b854-00ea81383c6b tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Getting quotas for project 990014bc19574d66ae5faae5c0751d5c. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:43:27.177898 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-fd7bc025-0d54-42eb-b854-00ea81383c6b tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Getting quotas for user ea95ad1fabb74ba692aa9172128035eb and project 990014bc19574d66ae5faae5c0751d5c. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:43:27.252108 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-fd7bc025-0d54-42eb-b854-00ea81383c6b tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Going to run 1 instances... {{(pid=118108) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:43:27.254226 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-fd7bc025-0d54-42eb-b854-00ea81383c6b tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5fb625d5-348c-4617-baaa-b74dda4a0a77',volume_size=None,volume_type=None)] {{(pid=118108) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:43:27.275010 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-aadfaf19-434d-4c04-bf8f-d1eb999736e2 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:27.275942 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-aadfaf19-434d-4c04-bf8f-d1eb999736e2 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:27.284796 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aadfaf19-434d-4c04-bf8f-d1eb999736e2 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:27.285411 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aadfaf19-434d-4c04-bf8f-d1eb999736e2 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:27.286397 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aadfaf19-434d-4c04-bf8f-d1eb999736e2 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:27.286986 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-aadfaf19-434d-4c04-bf8f-d1eb999736e2 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:27.291895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:27.439628 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-fd7bc025-0d54-42eb-b854-00ea81383c6b tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.631951 Jun 21 18:43:27.440697 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 487/976] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:43:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 18:43:27.455570 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-7067381b-2798-4b99-9072-a35914b8832c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:27.456305 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-7067381b-2798-4b99-9072-a35914b8832c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:27.509969 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-aadfaf19-434d-4c04-bf8f-d1eb999736e2 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:27.519082 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-aadfaf19-434d-4c04-bf8f-d1eb999736e2 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1265 microversion: 2.1 time: 0.254395 Jun 21 18:43:27.520844 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 490/977] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:27 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:27.557895 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-7067381b-2798-4b99-9072-a35914b8832c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:27.567863 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-7067381b-2798-4b99-9072-a35914b8832c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1088 microversion: 2.1 time: 0.116508 Jun 21 18:43:27.568812 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 488/978] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:27 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1088 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:27.785482 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f4e8ae6f-9e05-4c18-b127-295aedcdafbe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:27.787123 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f4e8ae6f-9e05-4c18-b127-295aedcdafbe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:27.795144 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f4e8ae6f-9e05-4c18-b127-295aedcdafbe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:27.795565 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f4e8ae6f-9e05-4c18-b127-295aedcdafbe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:27.796354 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f4e8ae6f-9e05-4c18-b127-295aedcdafbe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:27.796791 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f4e8ae6f-9e05-4c18-b127-295aedcdafbe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:27.960167 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f4e8ae6f-9e05-4c18-b127-295aedcdafbe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:27.974756 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f4e8ae6f-9e05-4c18-b127-295aedcdafbe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:27.976375 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f4e8ae6f-9e05-4c18-b127-295aedcdafbe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:27.978386 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f4e8ae6f-9e05-4c18-b127-295aedcdafbe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1406 microversion: 2.20 time: 0.196867 Jun 21 18:43:27.979122 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 491/979] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:43:27 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:43:28.547544 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4dd7d3d3-a1ff-4cdb-a33a-eadf07b9fdee tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:28.548415 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4dd7d3d3-a1ff-4cdb-a33a-eadf07b9fdee tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:28.559497 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4dd7d3d3-a1ff-4cdb-a33a-eadf07b9fdee tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:28.560246 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4dd7d3d3-a1ff-4cdb-a33a-eadf07b9fdee tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:28.561606 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4dd7d3d3-a1ff-4cdb-a33a-eadf07b9fdee tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:28.562414 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4dd7d3d3-a1ff-4cdb-a33a-eadf07b9fdee tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:28.599034 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b5d53c7d-6fb0-4680-bed3-54dd2c89660c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:28.600142 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b5d53c7d-6fb0-4680-bed3-54dd2c89660c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:28.611380 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b5d53c7d-6fb0-4680-bed3-54dd2c89660c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:28.612322 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b5d53c7d-6fb0-4680-bed3-54dd2c89660c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:28.614081 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b5d53c7d-6fb0-4680-bed3-54dd2c89660c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:28.614864 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b5d53c7d-6fb0-4680-bed3-54dd2c89660c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:28.730742 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b5d53c7d-6fb0-4680-bed3-54dd2c89660c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:28.739206 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b5d53c7d-6fb0-4680-bed3-54dd2c89660c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1186 microversion: 2.1 time: 0.148390 Jun 21 18:43:28.740439 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 492/980] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:28 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1186 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:28.768526 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-4dd7d3d3-a1ff-4cdb-a33a-eadf07b9fdee tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:28.777279 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4dd7d3d3-a1ff-4cdb-a33a-eadf07b9fdee tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1265 microversion: 2.1 time: 0.235522 Jun 21 18:43:28.777930 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 489/981] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:28 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:29.005795 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-4010c0ae-7789-45cc-ab00-22fcf34654a5 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:29.006465 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-4010c0ae-7789-45cc-ab00-22fcf34654a5 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:29.014641 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4010c0ae-7789-45cc-ab00-22fcf34654a5 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:29.015098 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4010c0ae-7789-45cc-ab00-22fcf34654a5 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:29.015895 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4010c0ae-7789-45cc-ab00-22fcf34654a5 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:29.016333 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4010c0ae-7789-45cc-ab00-22fcf34654a5 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:29.220298 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-4010c0ae-7789-45cc-ab00-22fcf34654a5 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:29.233464 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-4010c0ae-7789-45cc-ab00-22fcf34654a5 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:29.235706 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-4010c0ae-7789-45cc-ab00-22fcf34654a5 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:29.238446 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-4010c0ae-7789-45cc-ab00-22fcf34654a5 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1597 microversion: 2.20 time: 0.237509 Jun 21 18:43:29.248799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 493/982] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:43:28 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1597 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:43:29.260748 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f75d1383-2fac-431f-84f0-e2c2f7925f16 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:29.261980 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f75d1383-2fac-431f-84f0-e2c2f7925f16 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:29.272491 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f75d1383-2fac-431f-84f0-e2c2f7925f16 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:29.274363 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f75d1383-2fac-431f-84f0-e2c2f7925f16 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:29.275142 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f75d1383-2fac-431f-84f0-e2c2f7925f16 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:29.275984 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f75d1383-2fac-431f-84f0-e2c2f7925f16 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:29.407296 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f75d1383-2fac-431f-84f0-e2c2f7925f16 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.151345 Jun 21 18:43:29.407896 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 490/983] 10.222.0.87 () {60 vars in 1315 bytes} [Tue Jun 21 18:43:29 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:43:29.761348 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b2d0ac29-a36a-4dd9-9539-56c838e93b7d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:29.762322 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b2d0ac29-a36a-4dd9-9539-56c838e93b7d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:29.767153 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:29.775095 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b2d0ac29-a36a-4dd9-9539-56c838e93b7d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:29.775891 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b2d0ac29-a36a-4dd9-9539-56c838e93b7d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:29.777034 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b2d0ac29-a36a-4dd9-9539-56c838e93b7d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:29.778593 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b2d0ac29-a36a-4dd9-9539-56c838e93b7d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:29.800431 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6e9752a7-c44b-435d-953f-072440e2914b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:29.801623 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-6e9752a7-c44b-435d-953f-072440e2914b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:29.838301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6e9752a7-c44b-435d-953f-072440e2914b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:29.839530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6e9752a7-c44b-435d-953f-072440e2914b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:29.841728 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6e9752a7-c44b-435d-953f-072440e2914b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:29.842903 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6e9752a7-c44b-435d-953f-072440e2914b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:29.874384 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=100 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:29.909180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b2d0ac29-a36a-4dd9-9539-56c838e93b7d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:29.926426 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b2d0ac29-a36a-4dd9-9539-56c838e93b7d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1204 microversion: 2.1 time: 0.171185 Jun 21 18:43:29.929769 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 494/984] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:29 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1204 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:43:30.217305 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6e9752a7-c44b-435d-953f-072440e2914b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:30.232342 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6e9752a7-c44b-435d-953f-072440e2914b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1265 microversion: 2.1 time: 0.440221 Jun 21 18:43:30.237261 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 491/985] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:29 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1265 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:30.954474 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-0766968a-9294-4f04-a751-66c29e515daf tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:30.956529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-0766968a-9294-4f04-a751-66c29e515daf tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:30.965825 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0766968a-9294-4f04-a751-66c29e515daf tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:30.966534 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0766968a-9294-4f04-a751-66c29e515daf tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:30.967587 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0766968a-9294-4f04-a751-66c29e515daf tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:30.968320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0766968a-9294-4f04-a751-66c29e515daf tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:31.100498 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-94797279-b66d-4857-be40-0dc89798c1b6 req-cd7a47f9-fcd4-498a-a3ae-47b0bbf9ef3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ba08486-1cfb-443b-9e39-ba65962dd01e", "tag": "bffcf1ea-ece3-4130-9438-75fbde5fa0bf"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:43:31.119051 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-94797279-b66d-4857-be40-0dc89798c1b6 req-cd7a47f9-fcd4-498a-a3ae-47b0bbf9ef3d service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:31.120147 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-94797279-b66d-4857-be40-0dc89798c1b6 req-cd7a47f9-fcd4-498a-a3ae-47b0bbf9ef3d service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:31.150148 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-94797279-b66d-4857-be40-0dc89798c1b6 req-cd7a47f9-fcd4-498a-a3ae-47b0bbf9ef3d service nova] Creating event network-changed:bffcf1ea-ece3-4130-9438-75fbde5fa0bf for instance 2ba08486-1cfb-443b-9e39-ba65962dd01e on hv-cinder-84460 Jun 21 18:43:31.165024 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-94797279-b66d-4857-be40-0dc89798c1b6 req-cd7a47f9-fcd4-498a-a3ae-47b0bbf9ef3d service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071948 Jun 21 18:43:31.166770 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 492/986] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:43:31.268308 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-52eced27-a592-4bcc-8f5b-deb7421ab24b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:31.275743 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-52eced27-a592-4bcc-8f5b-deb7421ab24b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:31.291239 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-52eced27-a592-4bcc-8f5b-deb7421ab24b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:31.291580 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-52eced27-a592-4bcc-8f5b-deb7421ab24b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:31.292403 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-52eced27-a592-4bcc-8f5b-deb7421ab24b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:31.292846 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-52eced27-a592-4bcc-8f5b-deb7421ab24b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:31.385204 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-0766968a-9294-4f04-a751-66c29e515daf tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:31.401771 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-0766968a-9294-4f04-a751-66c29e515daf tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1260 microversion: 2.1 time: 0.454972 Jun 21 18:43:31.403979 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 495/987] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:30 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1260 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:31.615456 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-52eced27-a592-4bcc-8f5b-deb7421ab24b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:31.632400 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-52eced27-a592-4bcc-8f5b-deb7421ab24b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1265 microversion: 2.1 time: 0.372100 Jun 21 18:43:31.634336 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 493/988] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:31 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1265 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:31.733535 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-3e866e48-c6cc-4598-b3eb-ddc7979ef02d req-d8f6014d-a18f-4f97-a763-8331aa2fc6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c5acc09-82a3-4cb4-9c04-f582cf629c63", "tag": "8410643e-d59e-415c-b889-359fc6fba852"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:43:31.763103 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-3e866e48-c6cc-4598-b3eb-ddc7979ef02d req-d8f6014d-a18f-4f97-a763-8331aa2fc6d6 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:31.764373 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-3e866e48-c6cc-4598-b3eb-ddc7979ef02d req-d8f6014d-a18f-4f97-a763-8331aa2fc6d6 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:31.791562 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-3e866e48-c6cc-4598-b3eb-ddc7979ef02d req-d8f6014d-a18f-4f97-a763-8331aa2fc6d6 service nova] Creating event network-changed:8410643e-d59e-415c-b889-359fc6fba852 for instance 7c5acc09-82a3-4cb4-9c04-f582cf629c63 on hv-cinder-84460 Jun 21 18:43:31.802986 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-3e866e48-c6cc-4598-b3eb-ddc7979ef02d req-d8f6014d-a18f-4f97-a763-8331aa2fc6d6 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075922 Jun 21 18:43:31.804426 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 496/989] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:43:32.420425 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-eee44c59-9295-48a4-a040-303b05fc75c7 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:32.421538 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-eee44c59-9295-48a4-a040-303b05fc75c7 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:32.428197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eee44c59-9295-48a4-a040-303b05fc75c7 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:32.428629 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eee44c59-9295-48a4-a040-303b05fc75c7 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:32.429426 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eee44c59-9295-48a4-a040-303b05fc75c7 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:32.429938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eee44c59-9295-48a4-a040-303b05fc75c7 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:32.633475 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-eee44c59-9295-48a4-a040-303b05fc75c7 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:32.642256 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-eee44c59-9295-48a4-a040-303b05fc75c7 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1260 microversion: 2.1 time: 0.225633 Jun 21 18:43:32.642840 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 494/990] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:32 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:32.653042 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-7875e639-1ec6-4289-b5d6-13313b8da409 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:32.654030 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-7875e639-1ec6-4289-b5d6-13313b8da409 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:32.660545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7875e639-1ec6-4289-b5d6-13313b8da409 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:32.661134 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7875e639-1ec6-4289-b5d6-13313b8da409 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:32.662339 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7875e639-1ec6-4289-b5d6-13313b8da409 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:32.662775 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7875e639-1ec6-4289-b5d6-13313b8da409 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:32.842780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-7875e639-1ec6-4289-b5d6-13313b8da409 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:32.857093 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-7875e639-1ec6-4289-b5d6-13313b8da409 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1265 microversion: 2.1 time: 0.208882 Jun 21 18:43:32.867742 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 497/991] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:32 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:33.659488 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b96c0066-71af-41ae-80a6-ed9910420e94 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:33.660174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b96c0066-71af-41ae-80a6-ed9910420e94 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:33.668025 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b96c0066-71af-41ae-80a6-ed9910420e94 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:33.668478 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b96c0066-71af-41ae-80a6-ed9910420e94 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:33.669273 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b96c0066-71af-41ae-80a6-ed9910420e94 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:33.669783 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b96c0066-71af-41ae-80a6-ed9910420e94 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:33.835876 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-b96c0066-71af-41ae-80a6-ed9910420e94 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:33.852309 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b96c0066-71af-41ae-80a6-ed9910420e94 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1260 microversion: 2.1 time: 0.196778 Jun 21 18:43:33.852996 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 495/992] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:33 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:33.875102 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1a51334f-9aea-41a1-a5cb-3d6ea5bb5646 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:33.876131 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1a51334f-9aea-41a1-a5cb-3d6ea5bb5646 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:33.883324 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1a51334f-9aea-41a1-a5cb-3d6ea5bb5646 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:33.883786 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1a51334f-9aea-41a1-a5cb-3d6ea5bb5646 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:33.884569 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1a51334f-9aea-41a1-a5cb-3d6ea5bb5646 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:33.885009 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1a51334f-9aea-41a1-a5cb-3d6ea5bb5646 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:34.039141 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1a51334f-9aea-41a1-a5cb-3d6ea5bb5646 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:34.047533 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1a51334f-9aea-41a1-a5cb-3d6ea5bb5646 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1265 microversion: 2.1 time: 0.176679 Jun 21 18:43:34.048126 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 498/993] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:33 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:34.533485 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-86bc8748-413b-43a1-be59-7e71b99fbbbc req-2b090bd0-d5eb-4c9c-b394-61d708278cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d8e4d2-7b70-415b-a82b-e217d55cef26", "name": "network-vif-plugged", "status": "completed", "tag": "7554a426-600d-477b-9a71-f583c2065650"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:43:34.538687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:34.546519 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-86bc8748-413b-43a1-be59-7e71b99fbbbc req-2b090bd0-d5eb-4c9c-b394-61d708278cf4 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:34.547010 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-86bc8748-413b-43a1-be59-7e71b99fbbbc req-2b090bd0-d5eb-4c9c-b394-61d708278cf4 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:34.560303 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-86bc8748-413b-43a1-be59-7e71b99fbbbc req-2b090bd0-d5eb-4c9c-b394-61d708278cf4 service nova] Creating event network-vif-plugged:7554a426-600d-477b-9a71-f583c2065650 for instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 on hv-cinder-84460 Jun 21 18:43:34.566252 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-86bc8748-413b-43a1-be59-7e71b99fbbbc req-2b090bd0-d5eb-4c9c-b394-61d708278cf4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036574 Jun 21 18:43:34.566747 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 496/994] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:43:34.879865 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2ca60f2b-cc56-4694-aab8-e7e88ffd89ff tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:34.881553 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-2ca60f2b-cc56-4694-aab8-e7e88ffd89ff tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:34.897050 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2ca60f2b-cc56-4694-aab8-e7e88ffd89ff tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:34.897890 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2ca60f2b-cc56-4694-aab8-e7e88ffd89ff tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:34.899277 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2ca60f2b-cc56-4694-aab8-e7e88ffd89ff tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:34.900032 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2ca60f2b-cc56-4694-aab8-e7e88ffd89ff tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:35.068532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f577dc24-ed50-4671-9de8-4eae1650e54c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:35.069152 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f577dc24-ed50-4671-9de8-4eae1650e54c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:35.077768 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f577dc24-ed50-4671-9de8-4eae1650e54c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:35.078219 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f577dc24-ed50-4671-9de8-4eae1650e54c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:35.079028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f577dc24-ed50-4671-9de8-4eae1650e54c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:35.079461 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f577dc24-ed50-4671-9de8-4eae1650e54c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:35.113976 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2ca60f2b-cc56-4694-aab8-e7e88ffd89ff tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:35.127783 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-2ca60f2b-cc56-4694-aab8-e7e88ffd89ff tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1260 microversion: 2.1 time: 0.258121 Jun 21 18:43:35.128858 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 499/995] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:34 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1260 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:35.281909 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f577dc24-ed50-4671-9de8-4eae1650e54c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:35.291864 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f577dc24-ed50-4671-9de8-4eae1650e54c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1265 microversion: 2.1 time: 0.229035 Jun 21 18:43:35.292584 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 497/996] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:35 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:36.155708 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bc87a3ad-ead2-4362-b2fb-c0822e1a8d17 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:36.156733 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-bc87a3ad-ead2-4362-b2fb-c0822e1a8d17 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:36.169381 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bc87a3ad-ead2-4362-b2fb-c0822e1a8d17 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:36.170584 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bc87a3ad-ead2-4362-b2fb-c0822e1a8d17 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:36.172313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bc87a3ad-ead2-4362-b2fb-c0822e1a8d17 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:36.173114 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bc87a3ad-ead2-4362-b2fb-c0822e1a8d17 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:36.310008 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-3d1ad8a7-a071-4595-ace0-cee4ad85db43 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:36.310691 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-3d1ad8a7-a071-4595-ace0-cee4ad85db43 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:36.318067 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3d1ad8a7-a071-4595-ace0-cee4ad85db43 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:36.318515 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3d1ad8a7-a071-4595-ace0-cee4ad85db43 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:36.319289 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3d1ad8a7-a071-4595-ace0-cee4ad85db43 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:36.319718 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3d1ad8a7-a071-4595-ace0-cee4ad85db43 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:36.345174 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-bc87a3ad-ead2-4362-b2fb-c0822e1a8d17 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:36.358800 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-bc87a3ad-ead2-4362-b2fb-c0822e1a8d17 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1260 microversion: 2.1 time: 0.210535 Jun 21 18:43:36.359431 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 500/997] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:36 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1260 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:36.481133 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-3d1ad8a7-a071-4595-ace0-cee4ad85db43 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:36.490712 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-3d1ad8a7-a071-4595-ace0-cee4ad85db43 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1265 microversion: 2.1 time: 0.184704 Jun 21 18:43:36.491299 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 498/998] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:36 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:37.378304 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-92440f77-aa72-4566-afe2-3fffecc0a371 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:37.379308 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-92440f77-aa72-4566-afe2-3fffecc0a371 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:37.388254 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-92440f77-aa72-4566-afe2-3fffecc0a371 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:37.388706 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-92440f77-aa72-4566-afe2-3fffecc0a371 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:37.389497 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-92440f77-aa72-4566-afe2-3fffecc0a371 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:37.389955 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-92440f77-aa72-4566-afe2-3fffecc0a371 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:37.509053 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-bd7744af-9c60-4939-bc02-1de69d24976c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:37.510159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-bd7744af-9c60-4939-bc02-1de69d24976c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:37.512554 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=2 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:37.519705 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bd7744af-9c60-4939-bc02-1de69d24976c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:37.521373 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bd7744af-9c60-4939-bc02-1de69d24976c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:37.521574 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bd7744af-9c60-4939-bc02-1de69d24976c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:37.522029 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bd7744af-9c60-4939-bc02-1de69d24976c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:37.540205 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-92440f77-aa72-4566-afe2-3fffecc0a371 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:37.548588 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-92440f77-aa72-4566-afe2-3fffecc0a371 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1260 microversion: 2.1 time: 0.174745 Jun 21 18:43:37.549179 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 501/999] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:37 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:37.564652 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=8 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:43:37.681272 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-bd7744af-9c60-4939-bc02-1de69d24976c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:37.690734 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-bd7744af-9c60-4939-bc02-1de69d24976c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1451 microversion: 2.1 time: 0.185944 Jun 21 18:43:37.691455 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 499/1000] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:37 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1451 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:43:37.709909 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f75f260b-1c0e-47a0-9337-088ad4d4fc81 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:37.710535 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f75f260b-1c0e-47a0-9337-088ad4d4fc81 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:37.718186 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f75f260b-1c0e-47a0-9337-088ad4d4fc81 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:37.718624 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f75f260b-1c0e-47a0-9337-088ad4d4fc81 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:37.719402 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f75f260b-1c0e-47a0-9337-088ad4d4fc81 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:37.719827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f75f260b-1c0e-47a0-9337-088ad4d4fc81 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:37.880138 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f75f260b-1c0e-47a0-9337-088ad4d4fc81 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:37.888047 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f75f260b-1c0e-47a0-9337-088ad4d4fc81 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1451 microversion: 2.1 time: 0.183313 Jun 21 18:43:37.888621 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 502/1001] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:37 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1451 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:38.572664 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-49653469-ab09-4025-a53d-a332f9cd4971 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:38.573846 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-49653469-ab09-4025-a53d-a332f9cd4971 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:38.590599 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-49653469-ab09-4025-a53d-a332f9cd4971 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:38.591430 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-49653469-ab09-4025-a53d-a332f9cd4971 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:38.593239 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-49653469-ab09-4025-a53d-a332f9cd4971 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:38.594447 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-49653469-ab09-4025-a53d-a332f9cd4971 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:38.788295 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-49653469-ab09-4025-a53d-a332f9cd4971 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:38.798101 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-49653469-ab09-4025-a53d-a332f9cd4971 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1260 microversion: 2.1 time: 0.233651 Jun 21 18:43:38.799068 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 500/1002] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:38 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:39.824443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f139fbd3-acba-49c9-a2c0-ea97f7b05cf4 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:39.825379 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f139fbd3-acba-49c9-a2c0-ea97f7b05cf4 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:39.833829 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f139fbd3-acba-49c9-a2c0-ea97f7b05cf4 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:39.834291 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f139fbd3-acba-49c9-a2c0-ea97f7b05cf4 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:39.835102 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f139fbd3-acba-49c9-a2c0-ea97f7b05cf4 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:39.835542 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f139fbd3-acba-49c9-a2c0-ea97f7b05cf4 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:39.967098 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-1fb77e27-8f47-4fe0-b8eb-b77fb536b6c3 req-327b5c9b-4b81-4f07-afb5-92adbff08fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7d8e4d2-7b70-415b-a82b-e217d55cef26", "tag": "7554a426-600d-477b-9a71-f583c2065650"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:43:39.977282 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-1fb77e27-8f47-4fe0-b8eb-b77fb536b6c3 req-327b5c9b-4b81-4f07-afb5-92adbff08fc8 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:39.977816 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-1fb77e27-8f47-4fe0-b8eb-b77fb536b6c3 req-327b5c9b-4b81-4f07-afb5-92adbff08fc8 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:39.990775 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-1fb77e27-8f47-4fe0-b8eb-b77fb536b6c3 req-327b5c9b-4b81-4f07-afb5-92adbff08fc8 service nova] Creating event network-changed:7554a426-600d-477b-9a71-f583c2065650 for instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 on hv-cinder-84460 Jun 21 18:43:39.996819 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-1fb77e27-8f47-4fe0-b8eb-b77fb536b6c3 req-327b5c9b-4b81-4f07-afb5-92adbff08fc8 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033370 Jun 21 18:43:39.997877 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 501/1003] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:43:40.032203 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f139fbd3-acba-49c9-a2c0-ea97f7b05cf4 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:40.047934 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f139fbd3-acba-49c9-a2c0-ea97f7b05cf4 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1260 microversion: 2.1 time: 0.227009 Jun 21 18:43:40.049124 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 503/1004] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:39 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:43:41.074662 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-23cb5842-6494-41ea-bbf8-5974791922d5 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:41.075775 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-23cb5842-6494-41ea-bbf8-5974791922d5 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:41.088299 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-23cb5842-6494-41ea-bbf8-5974791922d5 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:41.089097 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-23cb5842-6494-41ea-bbf8-5974791922d5 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:41.090478 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-23cb5842-6494-41ea-bbf8-5974791922d5 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:41.091237 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-23cb5842-6494-41ea-bbf8-5974791922d5 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:41.329305 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-23cb5842-6494-41ea-bbf8-5974791922d5 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:41.343855 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-23cb5842-6494-41ea-bbf8-5974791922d5 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1260 microversion: 2.1 time: 0.279351 Jun 21 18:43:41.344646 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 502/1005] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:41 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1260 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:42.365827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-36c75af5-df32-4e55-859a-6366582dbe6c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:42.366744 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-36c75af5-df32-4e55-859a-6366582dbe6c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:42.374907 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-36c75af5-df32-4e55-859a-6366582dbe6c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:42.375354 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-36c75af5-df32-4e55-859a-6366582dbe6c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:42.376137 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-36c75af5-df32-4e55-859a-6366582dbe6c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:42.376569 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-36c75af5-df32-4e55-859a-6366582dbe6c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:42.569448 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-36c75af5-df32-4e55-859a-6366582dbe6c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:42.578620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-36c75af5-df32-4e55-859a-6366582dbe6c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1260 microversion: 2.1 time: 0.217295 Jun 21 18:43:42.579285 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 504/1006] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:42 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:43:42.652017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-d28005aa-2a5b-45e5-9a83-7d06236c59ae req-8db7b9dd-c7b2-4ec2-83ec-5f478d65a518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c5acc09-82a3-4cb4-9c04-f582cf629c63", "name": "network-vif-plugged", "status": "completed", "tag": "8410643e-d59e-415c-b889-359fc6fba852"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:43:42.662340 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-d28005aa-2a5b-45e5-9a83-7d06236c59ae req-8db7b9dd-c7b2-4ec2-83ec-5f478d65a518 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:42.662788 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-d28005aa-2a5b-45e5-9a83-7d06236c59ae req-8db7b9dd-c7b2-4ec2-83ec-5f478d65a518 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:42.676264 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-d28005aa-2a5b-45e5-9a83-7d06236c59ae req-8db7b9dd-c7b2-4ec2-83ec-5f478d65a518 service nova] Creating event network-vif-plugged:8410643e-d59e-415c-b889-359fc6fba852 for instance 7c5acc09-82a3-4cb4-9c04-f582cf629c63 on hv-cinder-84460 Jun 21 18:43:42.682525 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-d28005aa-2a5b-45e5-9a83-7d06236c59ae req-8db7b9dd-c7b2-4ec2-83ec-5f478d65a518 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034177 Jun 21 18:43:42.683440 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 503/1007] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:43:43.598106 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-fcd7943e-1bd4-43d1-b58b-34f4b9317154 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:43.598838 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-fcd7943e-1bd4-43d1-b58b-34f4b9317154 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:43.606988 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fcd7943e-1bd4-43d1-b58b-34f4b9317154 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:43.607446 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fcd7943e-1bd4-43d1-b58b-34f4b9317154 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:43.608237 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fcd7943e-1bd4-43d1-b58b-34f4b9317154 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:43.608673 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fcd7943e-1bd4-43d1-b58b-34f4b9317154 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:43.792499 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-fcd7943e-1bd4-43d1-b58b-34f4b9317154 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:43.806703 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-fcd7943e-1bd4-43d1-b58b-34f4b9317154 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1260 microversion: 2.1 time: 0.212181 Jun 21 18:43:43.807499 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 505/1008] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:43 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:44.828584 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-0ec8399e-a7ce-4c7e-ae8a-01e467eca7aa tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:44.829663 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-0ec8399e-a7ce-4c7e-ae8a-01e467eca7aa tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:44.837668 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0ec8399e-a7ce-4c7e-ae8a-01e467eca7aa tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:44.838119 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0ec8399e-a7ce-4c7e-ae8a-01e467eca7aa tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:44.839286 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0ec8399e-a7ce-4c7e-ae8a-01e467eca7aa tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:44.839803 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0ec8399e-a7ce-4c7e-ae8a-01e467eca7aa tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:45.038214 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-0ec8399e-a7ce-4c7e-ae8a-01e467eca7aa tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:45.047078 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-0ec8399e-a7ce-4c7e-ae8a-01e467eca7aa tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1443 microversion: 2.1 time: 0.223708 Jun 21 18:43:45.047668 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 504/1009] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:44 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1443 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:45.078017 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b5af7fc4-faf6-459a-bf18-2f37816cd00d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:43:45.079098 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b5af7fc4-faf6-459a-bf18-2f37816cd00d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:43:45.094420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b5af7fc4-faf6-459a-bf18-2f37816cd00d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:45.095178 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b5af7fc4-faf6-459a-bf18-2f37816cd00d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:45.096546 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b5af7fc4-faf6-459a-bf18-2f37816cd00d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:45.097315 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b5af7fc4-faf6-459a-bf18-2f37816cd00d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:45.298542 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b5af7fc4-faf6-459a-bf18-2f37816cd00d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:43:45.310420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b5af7fc4-faf6-459a-bf18-2f37816cd00d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1443 microversion: 2.1 time: 0.239594 Jun 21 18:43:45.310917 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 506/1010] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:43:45 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1443 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:43:47.631842 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-8c16b96e-e0a9-44ab-ae9e-bbb48a92f1eb req-cb72a84d-28b1-4e61-97f1-c9acb5362137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c5acc09-82a3-4cb4-9c04-f582cf629c63", "tag": "8410643e-d59e-415c-b889-359fc6fba852"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:43:47.648998 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-8c16b96e-e0a9-44ab-ae9e-bbb48a92f1eb req-cb72a84d-28b1-4e61-97f1-c9acb5362137 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:43:47.649731 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-8c16b96e-e0a9-44ab-ae9e-bbb48a92f1eb req-cb72a84d-28b1-4e61-97f1-c9acb5362137 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:43:47.679156 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-8c16b96e-e0a9-44ab-ae9e-bbb48a92f1eb req-cb72a84d-28b1-4e61-97f1-c9acb5362137 service nova] Creating event network-changed:8410643e-d59e-415c-b889-359fc6fba852 for instance 7c5acc09-82a3-4cb4-9c04-f582cf629c63 on hv-cinder-84460 Jun 21 18:43:47.686954 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-8c16b96e-e0a9-44ab-ae9e-bbb48a92f1eb req-cb72a84d-28b1-4e61-97f1-c9acb5362137 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061937 Jun 21 18:43:47.688178 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 505/1011] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:44:47.089896 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=25 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:44:47.090750 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=96 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:44:47.095427 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-60997198-6123-4558-85ba-d964f04ad9a2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:44:47.095986 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-60997198-6123-4558-85ba-d964f04ad9a2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:44:47.103833 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-60997198-6123-4558-85ba-d964f04ad9a2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:47.104357 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-60997198-6123-4558-85ba-d964f04ad9a2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:47.105168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-60997198-6123-4558-85ba-d964f04ad9a2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:47.105694 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-60997198-6123-4558-85ba-d964f04ad9a2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:47.139324 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-60997198-6123-4558-85ba-d964f04ad9a2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e/ips" status: 200 len: 151 microversion: 2.20 time: 0.051280 Jun 21 18:44:47.140103 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 507/1012] 10.222.0.87 () {60 vars in 1288 bytes} [Tue Jun 21 18:44:47 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e/ips => generated 151 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:44:49.484749 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=19 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:44:49.485843 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=68 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:44:49.493089 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c8a6ceda-e7a4-4cc5-8159-212995a9f3d2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:44:49.494021 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c8a6ceda-e7a4-4cc5-8159-212995a9f3d2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:44:49.502376 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c8a6ceda-e7a4-4cc5-8159-212995a9f3d2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:49.502878 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c8a6ceda-e7a4-4cc5-8159-212995a9f3d2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:49.503884 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c8a6ceda-e7a4-4cc5-8159-212995a9f3d2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:49.504399 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c8a6ceda-e7a4-4cc5-8159-212995a9f3d2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:49.534658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.objects.instance [None req-c8a6ceda-e7a4-4cc5-8159-212995a9f3d2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lazy-loading 'flavor' on Instance uuid 2ba08486-1cfb-443b-9e39-ba65962dd01e {{(pid=118108) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:44:50.063925 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c8a6ceda-e7a4-4cc5-8159-212995a9f3d2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "POST /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e/action" status: 202 len: 0 microversion: 2.20 time: 0.582752 Jun 21 18:44:50.064732 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 506/1013] 10.222.0.87 () {62 vars in 1318 bytes} [Tue Jun 21 18:44:49 2022] POST /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:44:50.080072 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-9cb88b2f-33fb-44ea-bfd1-3eb47aa18c23 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:44:50.081679 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-9cb88b2f-33fb-44ea-bfd1-3eb47aa18c23 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:44:50.095057 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9cb88b2f-33fb-44ea-bfd1-3eb47aa18c23 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:50.095963 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9cb88b2f-33fb-44ea-bfd1-3eb47aa18c23 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:50.097550 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9cb88b2f-33fb-44ea-bfd1-3eb47aa18c23 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:50.098314 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9cb88b2f-33fb-44ea-bfd1-3eb47aa18c23 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:50.296226 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-9cb88b2f-33fb-44ea-bfd1-3eb47aa18c23 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:50.305602 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-9cb88b2f-33fb-44ea-bfd1-3eb47aa18c23 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:50.307154 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-9cb88b2f-33fb-44ea-bfd1-3eb47aa18c23 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:50.308362 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-9cb88b2f-33fb-44ea-bfd1-3eb47aa18c23 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1722 microversion: 2.20 time: 0.236149 Jun 21 18:44:50.308960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 508/1014] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:44:50 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:44:51.337177 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-04e9b32f-7113-4c60-9b9f-2a5b09386c5d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:44:51.339035 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-04e9b32f-7113-4c60-9b9f-2a5b09386c5d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:44:51.346732 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-04e9b32f-7113-4c60-9b9f-2a5b09386c5d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:51.347256 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-04e9b32f-7113-4c60-9b9f-2a5b09386c5d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:51.348146 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-04e9b32f-7113-4c60-9b9f-2a5b09386c5d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:51.349095 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-04e9b32f-7113-4c60-9b9f-2a5b09386c5d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:51.503986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-04e9b32f-7113-4c60-9b9f-2a5b09386c5d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:51.514034 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-04e9b32f-7113-4c60-9b9f-2a5b09386c5d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:51.515519 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-04e9b32f-7113-4c60-9b9f-2a5b09386c5d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:51.516700 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-04e9b32f-7113-4c60-9b9f-2a5b09386c5d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1722 microversion: 2.20 time: 0.185574 Jun 21 18:44:51.517254 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 507/1015] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:44:51 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:44:52.537158 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-374582b9-83f3-4e76-8d30-6afd96251f4f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:44:52.537890 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-374582b9-83f3-4e76-8d30-6afd96251f4f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:44:52.545045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-374582b9-83f3-4e76-8d30-6afd96251f4f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:52.545515 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-374582b9-83f3-4e76-8d30-6afd96251f4f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:52.546420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-374582b9-83f3-4e76-8d30-6afd96251f4f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:52.546853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-374582b9-83f3-4e76-8d30-6afd96251f4f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:52.716747 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-374582b9-83f3-4e76-8d30-6afd96251f4f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:52.725763 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-374582b9-83f3-4e76-8d30-6afd96251f4f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:52.727290 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-374582b9-83f3-4e76-8d30-6afd96251f4f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:52.728506 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-374582b9-83f3-4e76-8d30-6afd96251f4f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1722 microversion: 2.20 time: 0.196516 Jun 21 18:44:52.729114 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 509/1016] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:44:52 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:44:53.747945 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-713a7286-a7f8-4001-af5d-2e2fcdace824 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:44:53.748623 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-713a7286-a7f8-4001-af5d-2e2fcdace824 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:44:53.756369 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-713a7286-a7f8-4001-af5d-2e2fcdace824 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:53.756832 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-713a7286-a7f8-4001-af5d-2e2fcdace824 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:53.757622 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-713a7286-a7f8-4001-af5d-2e2fcdace824 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:53.758106 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-713a7286-a7f8-4001-af5d-2e2fcdace824 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:53.924328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-713a7286-a7f8-4001-af5d-2e2fcdace824 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:53.934666 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-713a7286-a7f8-4001-af5d-2e2fcdace824 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:53.936238 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-713a7286-a7f8-4001-af5d-2e2fcdace824 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:53.937539 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-713a7286-a7f8-4001-af5d-2e2fcdace824 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1722 microversion: 2.20 time: 0.193778 Jun 21 18:44:53.938230 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 508/1017] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:44:53 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:44:54.960676 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ac31b2b5-0964-4616-b633-6b875661d234 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:44:54.961333 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ac31b2b5-0964-4616-b633-6b875661d234 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:44:54.969128 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ac31b2b5-0964-4616-b633-6b875661d234 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:54.969573 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ac31b2b5-0964-4616-b633-6b875661d234 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:54.970388 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ac31b2b5-0964-4616-b633-6b875661d234 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:54.970815 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ac31b2b5-0964-4616-b633-6b875661d234 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:55.176451 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ac31b2b5-0964-4616-b633-6b875661d234 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:55.186067 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ac31b2b5-0964-4616-b633-6b875661d234 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:55.187608 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ac31b2b5-0964-4616-b633-6b875661d234 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:55.188817 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ac31b2b5-0964-4616-b633-6b875661d234 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1722 microversion: 2.20 time: 0.233189 Jun 21 18:44:55.189516 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 510/1018] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:44:54 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:44:56.210574 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-2c461c9c-dcf3-4243-bb20-aab0b4ee3465 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:44:56.211685 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-2c461c9c-dcf3-4243-bb20-aab0b4ee3465 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:44:56.219607 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2c461c9c-dcf3-4243-bb20-aab0b4ee3465 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:56.220049 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2c461c9c-dcf3-4243-bb20-aab0b4ee3465 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:56.220843 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2c461c9c-dcf3-4243-bb20-aab0b4ee3465 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:56.221271 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-2c461c9c-dcf3-4243-bb20-aab0b4ee3465 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:56.403328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2c461c9c-dcf3-4243-bb20-aab0b4ee3465 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:56.413266 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2c461c9c-dcf3-4243-bb20-aab0b4ee3465 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:56.414912 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-2c461c9c-dcf3-4243-bb20-aab0b4ee3465 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:56.416130 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-2c461c9c-dcf3-4243-bb20-aab0b4ee3465 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1722 microversion: 2.20 time: 0.210973 Jun 21 18:44:56.416664 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 509/1019] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:44:56 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:44:57.447091 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-220c856e-e5db-48a2-8b28-902962a0bef3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:44:57.447756 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-220c856e-e5db-48a2-8b28-902962a0bef3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:44:57.455076 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-220c856e-e5db-48a2-8b28-902962a0bef3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:57.455526 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-220c856e-e5db-48a2-8b28-902962a0bef3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:57.456308 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-220c856e-e5db-48a2-8b28-902962a0bef3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:57.456717 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-220c856e-e5db-48a2-8b28-902962a0bef3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:57.612584 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-220c856e-e5db-48a2-8b28-902962a0bef3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:57.622759 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-220c856e-e5db-48a2-8b28-902962a0bef3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:57.624285 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-220c856e-e5db-48a2-8b28-902962a0bef3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:57.625619 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-220c856e-e5db-48a2-8b28-902962a0bef3 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1722 microversion: 2.20 time: 0.183428 Jun 21 18:44:57.626368 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 511/1020] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:44:57 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:44:58.646818 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-84a5984a-aad7-409a-b6af-bd1b331af5e4 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:44:58.647542 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-84a5984a-aad7-409a-b6af-bd1b331af5e4 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:44:58.655368 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-84a5984a-aad7-409a-b6af-bd1b331af5e4 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:58.655815 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-84a5984a-aad7-409a-b6af-bd1b331af5e4 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:58.656575 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-84a5984a-aad7-409a-b6af-bd1b331af5e4 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:58.657033 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-84a5984a-aad7-409a-b6af-bd1b331af5e4 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:58.800351 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-84a5984a-aad7-409a-b6af-bd1b331af5e4 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:58.810373 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-84a5984a-aad7-409a-b6af-bd1b331af5e4 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:58.811939 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-84a5984a-aad7-409a-b6af-bd1b331af5e4 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:44:58.813156 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-84a5984a-aad7-409a-b6af-bd1b331af5e4 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1722 microversion: 2.20 time: 0.171466 Jun 21 18:44:58.813743 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 510/1021] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:44:58 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:44:59.845915 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-445f77f5-3d3d-4c83-82d4-32fc6b35b04c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:44:59.846986 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-445f77f5-3d3d-4c83-82d4-32fc6b35b04c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:44:59.854182 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-445f77f5-3d3d-4c83-82d4-32fc6b35b04c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:59.854631 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-445f77f5-3d3d-4c83-82d4-32fc6b35b04c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:44:59.855410 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-445f77f5-3d3d-4c83-82d4-32fc6b35b04c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:44:59.855841 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-445f77f5-3d3d-4c83-82d4-32fc6b35b04c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:00.002145 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-445f77f5-3d3d-4c83-82d4-32fc6b35b04c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:00.011500 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-445f77f5-3d3d-4c83-82d4-32fc6b35b04c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:00.012981 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-445f77f5-3d3d-4c83-82d4-32fc6b35b04c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:00.014306 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-445f77f5-3d3d-4c83-82d4-32fc6b35b04c tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1722 microversion: 2.20 time: 0.174735 Jun 21 18:45:00.014850 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 512/1022] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:44:59 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:01.043183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5a474a00-6858-455c-b15d-46bb108069aa tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:01.043784 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-5a474a00-6858-455c-b15d-46bb108069aa tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:01.051384 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5a474a00-6858-455c-b15d-46bb108069aa tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:01.052356 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5a474a00-6858-455c-b15d-46bb108069aa tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:01.053175 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5a474a00-6858-455c-b15d-46bb108069aa tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:01.053624 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5a474a00-6858-455c-b15d-46bb108069aa tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:01.202755 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-5a474a00-6858-455c-b15d-46bb108069aa tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:01.212403 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-5a474a00-6858-455c-b15d-46bb108069aa tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:01.214081 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-5a474a00-6858-455c-b15d-46bb108069aa tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:01.215626 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-5a474a00-6858-455c-b15d-46bb108069aa tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1722 microversion: 2.20 time: 0.176560 Jun 21 18:45:01.216225 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 511/1023] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:01 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:02.235330 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f81800f9-ea4e-4bdb-8d0f-fe3bc3a5074a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:02.236341 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f81800f9-ea4e-4bdb-8d0f-fe3bc3a5074a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:02.244709 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f81800f9-ea4e-4bdb-8d0f-fe3bc3a5074a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:02.245506 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f81800f9-ea4e-4bdb-8d0f-fe3bc3a5074a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:02.246984 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f81800f9-ea4e-4bdb-8d0f-fe3bc3a5074a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:02.247856 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f81800f9-ea4e-4bdb-8d0f-fe3bc3a5074a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:02.433397 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f81800f9-ea4e-4bdb-8d0f-fe3bc3a5074a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:02.450652 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f81800f9-ea4e-4bdb-8d0f-fe3bc3a5074a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:02.452524 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f81800f9-ea4e-4bdb-8d0f-fe3bc3a5074a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:02.454597 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f81800f9-ea4e-4bdb-8d0f-fe3bc3a5074a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1743 microversion: 2.20 time: 0.223903 Jun 21 18:45:02.455419 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 513/1024] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:02 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1743 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:03.477007 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-9a03ee69-92d7-4885-bb9b-0d945938db95 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:03.478124 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-9a03ee69-92d7-4885-bb9b-0d945938db95 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:03.486150 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9a03ee69-92d7-4885-bb9b-0d945938db95 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:03.486601 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9a03ee69-92d7-4885-bb9b-0d945938db95 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:03.487391 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9a03ee69-92d7-4885-bb9b-0d945938db95 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:03.487832 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-9a03ee69-92d7-4885-bb9b-0d945938db95 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:03.646829 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-9a03ee69-92d7-4885-bb9b-0d945938db95 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:03.656231 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-9a03ee69-92d7-4885-bb9b-0d945938db95 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:03.657783 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-9a03ee69-92d7-4885-bb9b-0d945938db95 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:03.658974 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-9a03ee69-92d7-4885-bb9b-0d945938db95 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1743 microversion: 2.20 time: 0.187822 Jun 21 18:45:03.659533 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 512/1025] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:03 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1743 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:04.678514 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2ab0c711-1502-4aea-a68f-fa900064fa7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:04.679116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-2ab0c711-1502-4aea-a68f-fa900064fa7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:04.686443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2ab0c711-1502-4aea-a68f-fa900064fa7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:04.686894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2ab0c711-1502-4aea-a68f-fa900064fa7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:04.687673 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2ab0c711-1502-4aea-a68f-fa900064fa7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:04.688109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2ab0c711-1502-4aea-a68f-fa900064fa7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:04.842417 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2ab0c711-1502-4aea-a68f-fa900064fa7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:04.852988 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2ab0c711-1502-4aea-a68f-fa900064fa7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:04.854937 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2ab0c711-1502-4aea-a68f-fa900064fa7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:04.855801 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-2ab0c711-1502-4aea-a68f-fa900064fa7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1743 microversion: 2.20 time: 0.181544 Jun 21 18:45:04.856366 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 514/1026] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:04 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1743 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:04.945170 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-73504f68-fd5c-4af9-b6c7-9cd629cf50d0 req-08a21b66-fe62-4f5d-a0f5-9aa7e4598719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba08486-1cfb-443b-9e39-ba65962dd01e", "name": "network-vif-plugged", "status": "completed", "tag": "bffcf1ea-ece3-4130-9438-75fbde5fa0bf"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:45:04.955257 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-73504f68-fd5c-4af9-b6c7-9cd629cf50d0 req-08a21b66-fe62-4f5d-a0f5-9aa7e4598719 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:04.955793 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-73504f68-fd5c-4af9-b6c7-9cd629cf50d0 req-08a21b66-fe62-4f5d-a0f5-9aa7e4598719 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:04.968983 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-73504f68-fd5c-4af9-b6c7-9cd629cf50d0 req-08a21b66-fe62-4f5d-a0f5-9aa7e4598719 service nova] Creating event network-vif-plugged:bffcf1ea-ece3-4130-9438-75fbde5fa0bf for instance 2ba08486-1cfb-443b-9e39-ba65962dd01e on hv-cinder-84460 Jun 21 18:45:04.974848 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-73504f68-fd5c-4af9-b6c7-9cd629cf50d0 req-08a21b66-fe62-4f5d-a0f5-9aa7e4598719 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033499 Jun 21 18:45:04.975470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 513/1027] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:45:05.883365 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1bb1dbf7-52a2-442b-a503-0ea9a3458c98 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:05.884560 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1bb1dbf7-52a2-442b-a503-0ea9a3458c98 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:05.892703 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1bb1dbf7-52a2-442b-a503-0ea9a3458c98 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:05.893148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1bb1dbf7-52a2-442b-a503-0ea9a3458c98 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:05.893998 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1bb1dbf7-52a2-442b-a503-0ea9a3458c98 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:05.894437 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1bb1dbf7-52a2-442b-a503-0ea9a3458c98 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:06.086228 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1bb1dbf7-52a2-442b-a503-0ea9a3458c98 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:06.101014 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1bb1dbf7-52a2-442b-a503-0ea9a3458c98 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:06.102613 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1bb1dbf7-52a2-442b-a503-0ea9a3458c98 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:06.103853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1bb1dbf7-52a2-442b-a503-0ea9a3458c98 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1743 microversion: 2.20 time: 0.224702 Jun 21 18:45:06.104432 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 515/1028] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:05 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1743 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:07.130071 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-1e673fe9-2163-44bf-8b3e-dc6b3e7903de tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:07.130897 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-1e673fe9-2163-44bf-8b3e-dc6b3e7903de tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:07.137867 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1e673fe9-2163-44bf-8b3e-dc6b3e7903de tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:07.138316 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1e673fe9-2163-44bf-8b3e-dc6b3e7903de tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:07.139110 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1e673fe9-2163-44bf-8b3e-dc6b3e7903de tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:07.139547 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1e673fe9-2163-44bf-8b3e-dc6b3e7903de tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:07.338504 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-1e673fe9-2163-44bf-8b3e-dc6b3e7903de tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:07.355555 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-1e673fe9-2163-44bf-8b3e-dc6b3e7903de tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:07.359369 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-1e673fe9-2163-44bf-8b3e-dc6b3e7903de tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:07.362260 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-1e673fe9-2163-44bf-8b3e-dc6b3e7903de tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1743 microversion: 2.20 time: 0.236876 Jun 21 18:45:07.363435 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 514/1029] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:07 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1743 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:08.394518 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2e5a3a63-3492-4d09-a9a5-70cca3d64f94 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:08.395782 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-2e5a3a63-3492-4d09-a9a5-70cca3d64f94 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:08.405626 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2e5a3a63-3492-4d09-a9a5-70cca3d64f94 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:08.406933 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2e5a3a63-3492-4d09-a9a5-70cca3d64f94 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:08.408690 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2e5a3a63-3492-4d09-a9a5-70cca3d64f94 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:08.409810 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2e5a3a63-3492-4d09-a9a5-70cca3d64f94 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:08.648318 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2e5a3a63-3492-4d09-a9a5-70cca3d64f94 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:08.662716 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2e5a3a63-3492-4d09-a9a5-70cca3d64f94 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:08.665170 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2e5a3a63-3492-4d09-a9a5-70cca3d64f94 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:08.668331 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-2e5a3a63-3492-4d09-a9a5-70cca3d64f94 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1738 microversion: 2.20 time: 0.279085 Jun 21 18:45:08.670148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 516/1030] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:08 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1738 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:09.694380 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-bdb96a0c-53ff-490c-a50c-fe4009d2467e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:09.695082 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-bdb96a0c-53ff-490c-a50c-fe4009d2467e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:09.703112 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bdb96a0c-53ff-490c-a50c-fe4009d2467e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:09.703550 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bdb96a0c-53ff-490c-a50c-fe4009d2467e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:09.705294 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bdb96a0c-53ff-490c-a50c-fe4009d2467e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:09.706078 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bdb96a0c-53ff-490c-a50c-fe4009d2467e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:09.937286 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-bdb96a0c-53ff-490c-a50c-fe4009d2467e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:09.951607 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-bdb96a0c-53ff-490c-a50c-fe4009d2467e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:09.953950 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-bdb96a0c-53ff-490c-a50c-fe4009d2467e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:09.955487 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-bdb96a0c-53ff-490c-a50c-fe4009d2467e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1738 microversion: 2.20 time: 0.266826 Jun 21 18:45:09.956319 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 515/1031] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:09 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:10.983145 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c3cf9570-f07e-4d2f-a389-44a8db6488d6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:10.984182 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c3cf9570-f07e-4d2f-a389-44a8db6488d6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:10.996638 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c3cf9570-f07e-4d2f-a389-44a8db6488d6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:10.997565 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c3cf9570-f07e-4d2f-a389-44a8db6488d6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:10.999376 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c3cf9570-f07e-4d2f-a389-44a8db6488d6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:11.000037 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c3cf9570-f07e-4d2f-a389-44a8db6488d6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:11.194617 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c3cf9570-f07e-4d2f-a389-44a8db6488d6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:11.204695 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c3cf9570-f07e-4d2f-a389-44a8db6488d6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:11.206829 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c3cf9570-f07e-4d2f-a389-44a8db6488d6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:11.208613 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c3cf9570-f07e-4d2f-a389-44a8db6488d6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1738 microversion: 2.20 time: 0.230609 Jun 21 18:45:11.209191 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 517/1032] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:10 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:12.240260 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-04e3229b-450a-4158-adf6-560db0455ac7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:12.241410 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-04e3229b-450a-4158-adf6-560db0455ac7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:12.256055 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-04e3229b-450a-4158-adf6-560db0455ac7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:12.257906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-04e3229b-450a-4158-adf6-560db0455ac7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:12.259318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-04e3229b-450a-4158-adf6-560db0455ac7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:12.260059 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-04e3229b-450a-4158-adf6-560db0455ac7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:12.525925 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-04e3229b-450a-4158-adf6-560db0455ac7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:12.545952 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-04e3229b-450a-4158-adf6-560db0455ac7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:12.549235 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-04e3229b-450a-4158-adf6-560db0455ac7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:12.552231 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-04e3229b-450a-4158-adf6-560db0455ac7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1738 microversion: 2.20 time: 0.320009 Jun 21 18:45:12.570393 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 516/1033] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:12 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1738 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:13.584647 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-87dccb86-d19b-4e61-a08b-b1b65d857d1d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:13.585449 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-87dccb86-d19b-4e61-a08b-b1b65d857d1d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:13.592886 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-87dccb86-d19b-4e61-a08b-b1b65d857d1d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:13.593360 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-87dccb86-d19b-4e61-a08b-b1b65d857d1d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:13.594149 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-87dccb86-d19b-4e61-a08b-b1b65d857d1d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:13.594750 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-87dccb86-d19b-4e61-a08b-b1b65d857d1d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:13.777975 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-87dccb86-d19b-4e61-a08b-b1b65d857d1d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:13.789025 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-87dccb86-d19b-4e61-a08b-b1b65d857d1d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:13.790591 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-87dccb86-d19b-4e61-a08b-b1b65d857d1d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:13.791836 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-87dccb86-d19b-4e61-a08b-b1b65d857d1d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1738 microversion: 2.20 time: 0.212590 Jun 21 18:45:13.793168 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 518/1034] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:13 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:14.824285 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-512fe8d0-8696-461e-80e6-84104d0a493e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:14.825511 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-512fe8d0-8696-461e-80e6-84104d0a493e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:14.842773 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-512fe8d0-8696-461e-80e6-84104d0a493e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:14.843599 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-512fe8d0-8696-461e-80e6-84104d0a493e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:14.845311 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-512fe8d0-8696-461e-80e6-84104d0a493e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:14.849168 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-512fe8d0-8696-461e-80e6-84104d0a493e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:15.079404 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-512fe8d0-8696-461e-80e6-84104d0a493e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:15.093174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-512fe8d0-8696-461e-80e6-84104d0a493e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:15.096310 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-512fe8d0-8696-461e-80e6-84104d0a493e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:15.098380 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-512fe8d0-8696-461e-80e6-84104d0a493e tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1738 microversion: 2.20 time: 0.291364 Jun 21 18:45:15.099593 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 517/1035] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:14 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1738 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:16.127701 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b43795b1-403b-4096-af02-9d6be2a81274 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:16.128685 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b43795b1-403b-4096-af02-9d6be2a81274 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:16.142070 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b43795b1-403b-4096-af02-9d6be2a81274 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:16.142682 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b43795b1-403b-4096-af02-9d6be2a81274 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:16.144291 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b43795b1-403b-4096-af02-9d6be2a81274 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:16.145057 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b43795b1-403b-4096-af02-9d6be2a81274 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:16.407434 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b43795b1-403b-4096-af02-9d6be2a81274 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:16.424603 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b43795b1-403b-4096-af02-9d6be2a81274 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:16.428221 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b43795b1-403b-4096-af02-9d6be2a81274 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:16.430512 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b43795b1-403b-4096-af02-9d6be2a81274 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1738 microversion: 2.20 time: 0.310650 Jun 21 18:45:16.449956 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 519/1036] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:16 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:17.457022 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6184e638-795a-4c38-ab38-fa731ada9002 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:17.458112 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-6184e638-795a-4c38-ab38-fa731ada9002 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:17.467640 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6184e638-795a-4c38-ab38-fa731ada9002 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:17.468103 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6184e638-795a-4c38-ab38-fa731ada9002 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:17.469055 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6184e638-795a-4c38-ab38-fa731ada9002 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:17.469355 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6184e638-795a-4c38-ab38-fa731ada9002 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:17.652350 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6184e638-795a-4c38-ab38-fa731ada9002 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:17.663855 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6184e638-795a-4c38-ab38-fa731ada9002 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:17.667444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6184e638-795a-4c38-ab38-fa731ada9002 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:17.669610 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6184e638-795a-4c38-ab38-fa731ada9002 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1738 microversion: 2.20 time: 0.216313 Jun 21 18:45:17.670389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 518/1037] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:17 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:18.696653 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f0cd2b97-f128-4d23-8791-7ee98c58e319 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:18.697333 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f0cd2b97-f128-4d23-8791-7ee98c58e319 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:18.699993 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=27 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:45:18.706045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f0cd2b97-f128-4d23-8791-7ee98c58e319 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:18.706485 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f0cd2b97-f128-4d23-8791-7ee98c58e319 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:18.707262 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f0cd2b97-f128-4d23-8791-7ee98c58e319 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:18.708022 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f0cd2b97-f128-4d23-8791-7ee98c58e319 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:18.711773 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=77 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:45:18.868473 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f0cd2b97-f128-4d23-8791-7ee98c58e319 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:18.883692 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f0cd2b97-f128-4d23-8791-7ee98c58e319 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:18.886718 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f0cd2b97-f128-4d23-8791-7ee98c58e319 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:18.888866 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f0cd2b97-f128-4d23-8791-7ee98c58e319 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1738 microversion: 2.20 time: 0.196760 Jun 21 18:45:18.889900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 520/1038] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:18 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:19.913083 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c2c22b13-4fc8-48e6-8e45-8e6a7fb31b67 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:19.914408 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c2c22b13-4fc8-48e6-8e45-8e6a7fb31b67 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:19.918801 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=27 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:45:19.929386 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c2c22b13-4fc8-48e6-8e45-8e6a7fb31b67 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:19.930169 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c2c22b13-4fc8-48e6-8e45-8e6a7fb31b67 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:19.931599 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c2c22b13-4fc8-48e6-8e45-8e6a7fb31b67 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:19.932407 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c2c22b13-4fc8-48e6-8e45-8e6a7fb31b67 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:19.942562 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:45:20.124260 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c2c22b13-4fc8-48e6-8e45-8e6a7fb31b67 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:20.133621 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c2c22b13-4fc8-48e6-8e45-8e6a7fb31b67 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:20.135568 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c2c22b13-4fc8-48e6-8e45-8e6a7fb31b67 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:20.136773 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c2c22b13-4fc8-48e6-8e45-8e6a7fb31b67 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1720 microversion: 2.20 time: 0.231210 Jun 21 18:45:20.137453 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 519/1039] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:19 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1720 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:21.156507 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ed8aff4a-d0aa-4692-8592-d5217e14f240 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:21.157250 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ed8aff4a-d0aa-4692-8592-d5217e14f240 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:21.164430 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ed8aff4a-d0aa-4692-8592-d5217e14f240 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:21.164953 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ed8aff4a-d0aa-4692-8592-d5217e14f240 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:21.166205 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ed8aff4a-d0aa-4692-8592-d5217e14f240 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:21.166653 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ed8aff4a-d0aa-4692-8592-d5217e14f240 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:21.624337 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ed8aff4a-d0aa-4692-8592-d5217e14f240 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:21.637400 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ed8aff4a-d0aa-4692-8592-d5217e14f240 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:21.638954 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ed8aff4a-d0aa-4692-8592-d5217e14f240 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:21.640143 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ed8aff4a-d0aa-4692-8592-d5217e14f240 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1720 microversion: 2.20 time: 0.487844 Jun 21 18:45:21.640691 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 521/1040] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:21 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1720 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:22.664381 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-7981a54c-2bf3-4691-b47c-98f80e472e7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:22.665017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-7981a54c-2bf3-4691-b47c-98f80e472e7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:22.672379 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7981a54c-2bf3-4691-b47c-98f80e472e7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:22.672964 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7981a54c-2bf3-4691-b47c-98f80e472e7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:22.673976 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7981a54c-2bf3-4691-b47c-98f80e472e7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:22.674470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7981a54c-2bf3-4691-b47c-98f80e472e7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:22.830143 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-7981a54c-2bf3-4691-b47c-98f80e472e7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:22.839661 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-7981a54c-2bf3-4691-b47c-98f80e472e7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:22.841238 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-7981a54c-2bf3-4691-b47c-98f80e472e7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:22.842532 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-7981a54c-2bf3-4691-b47c-98f80e472e7f tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1663 microversion: 2.20 time: 0.182778 Jun 21 18:45:22.843105 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 520/1041] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:22 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1663 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:22.863115 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-09d4dc25-3a10-42ac-957c-39c54c469385 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c63c005c-596b-4081-898c-bfc9114bf412"}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:45:22.864368 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-09d4dc25-3a10-42ac-957c-39c54c469385 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:22.872202 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-09d4dc25-3a10-42ac-957c-39c54c469385 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:22.872718 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-09d4dc25-3a10-42ac-957c-39c54c469385 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:22.873546 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-09d4dc25-3a10-42ac-957c-39c54c469385 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:22.874073 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-09d4dc25-3a10-42ac-957c-39c54c469385 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:23.159636 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-c2292c07-48f9-4cc0-a9c5-9ccfc7204a24 req-f4a0b128-5066-4d3f-aa5f-b78b363ea701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba08486-1cfb-443b-9e39-ba65962dd01e", "name": "network-vif-unplugged", "status": "completed", "tag": "bffcf1ea-ece3-4130-9438-75fbde5fa0bf"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:45:23.169091 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-c2292c07-48f9-4cc0-a9c5-9ccfc7204a24 req-f4a0b128-5066-4d3f-aa5f-b78b363ea701 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:23.169735 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-c2292c07-48f9-4cc0-a9c5-9ccfc7204a24 req-f4a0b128-5066-4d3f-aa5f-b78b363ea701 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:23.183869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.compute.server_external_events [req-c2292c07-48f9-4cc0-a9c5-9ccfc7204a24 req-f4a0b128-5066-4d3f-aa5f-b78b363ea701 service nova] Unable to find a host for instance 2ba08486-1cfb-443b-9e39-ba65962dd01e. Dropping event network-vif-unplugged {{(pid=118108) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 21 18:45:23.185220 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-c2292c07-48f9-4cc0-a9c5-9ccfc7204a24 req-f4a0b128-5066-4d3f-aa5f-b78b363ea701 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029797 Jun 21 18:45:23.186300 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 521/1042] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 21 18:45:23.234341 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-09d4dc25-3a10-42ac-957c-39c54c469385 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "POST /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.374973 Jun 21 18:45:23.235188 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 522/1043] 10.222.0.87 () {62 vars in 1363 bytes} [Tue Jun 21 18:45:22 2022] POST /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e/os-volume_attachments => generated 188 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 18:45:23.369017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a7056dc1-90ad-4f30-9306-21bfe16db0c0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:23.369523 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-a7056dc1-90ad-4f30-9306-21bfe16db0c0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:23.376820 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a7056dc1-90ad-4f30-9306-21bfe16db0c0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:23.377315 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a7056dc1-90ad-4f30-9306-21bfe16db0c0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:23.378334 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a7056dc1-90ad-4f30-9306-21bfe16db0c0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:23.378907 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a7056dc1-90ad-4f30-9306-21bfe16db0c0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:23.686563 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a7056dc1-90ad-4f30-9306-21bfe16db0c0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "DELETE /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e/os-volume_attachments/c63c005c-596b-4081-898c-bfc9114bf412" status: 202 len: 0 microversion: 2.20 time: 0.321840 Jun 21 18:45:23.687730 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 522/1044] 10.222.0.87 () {60 vars in 1456 bytes} [Tue Jun 21 18:45:23 2022] DELETE /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e/os-volume_attachments/c63c005c-596b-4081-898c-bfc9114bf412 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:45:23.754453 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f7469c98-f285-4dee-b755-4708c1d020c0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:45:23.755693 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f7469c98-f285-4dee-b755-4708c1d020c0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:23.762548 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7469c98-f285-4dee-b755-4708c1d020c0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:23.762996 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7469c98-f285-4dee-b755-4708c1d020c0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:23.763765 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7469c98-f285-4dee-b755-4708c1d020c0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:23.764224 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f7469c98-f285-4dee-b755-4708c1d020c0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:23.859000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f7469c98-f285-4dee-b755-4708c1d020c0 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "POST /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e/action" status: 202 len: 0 microversion: 2.20 time: 0.108675 Jun 21 18:45:23.860101 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 523/1045] 10.222.0.87 () {62 vars in 1318 bytes} [Tue Jun 21 18:45:23 2022] POST /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:45:23.868619 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b3a8fbeb-af09-4623-89b4-7b4fd9d07461 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:23.869270 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b3a8fbeb-af09-4623-89b4-7b4fd9d07461 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:23.876164 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b3a8fbeb-af09-4623-89b4-7b4fd9d07461 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:23.876623 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b3a8fbeb-af09-4623-89b4-7b4fd9d07461 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:23.877557 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b3a8fbeb-af09-4623-89b4-7b4fd9d07461 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:23.878037 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b3a8fbeb-af09-4623-89b4-7b4fd9d07461 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:24.095604 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-b3a8fbeb-af09-4623-89b4-7b4fd9d07461 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:24.111363 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-b3a8fbeb-af09-4623-89b4-7b4fd9d07461 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:24.114723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-b3a8fbeb-af09-4623-89b4-7b4fd9d07461 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:24.116244 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b3a8fbeb-af09-4623-89b4-7b4fd9d07461 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1671 microversion: 2.20 time: 0.251945 Jun 21 18:45:24.117117 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 523/1046] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:23 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1671 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:45:25.149829 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-4dc9f079-f714-4280-8b28-80ac60313dbf tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:25.150900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-4dc9f079-f714-4280-8b28-80ac60313dbf tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:25.159365 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4dc9f079-f714-4280-8b28-80ac60313dbf tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:25.160059 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4dc9f079-f714-4280-8b28-80ac60313dbf tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:25.161454 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4dc9f079-f714-4280-8b28-80ac60313dbf tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:25.162077 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-4dc9f079-f714-4280-8b28-80ac60313dbf tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:25.376542 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-4dc9f079-f714-4280-8b28-80ac60313dbf tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:25.389787 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-4dc9f079-f714-4280-8b28-80ac60313dbf tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:25.391591 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-4dc9f079-f714-4280-8b28-80ac60313dbf tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:25.393131 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-4dc9f079-f714-4280-8b28-80ac60313dbf tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1729 microversion: 2.20 time: 0.251753 Jun 21 18:45:25.393919 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 524/1047] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:25 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1729 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:26.417356 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5737f419-f6d7-4564-8fd5-70c5c58e9363 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:26.419583 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-5737f419-f6d7-4564-8fd5-70c5c58e9363 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:26.438495 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5737f419-f6d7-4564-8fd5-70c5c58e9363 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:26.439781 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5737f419-f6d7-4564-8fd5-70c5c58e9363 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:26.441485 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5737f419-f6d7-4564-8fd5-70c5c58e9363 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:26.442735 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5737f419-f6d7-4564-8fd5-70c5c58e9363 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:26.627548 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-5737f419-f6d7-4564-8fd5-70c5c58e9363 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:26.639260 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-5737f419-f6d7-4564-8fd5-70c5c58e9363 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:26.641119 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-5737f419-f6d7-4564-8fd5-70c5c58e9363 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:26.642901 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-5737f419-f6d7-4564-8fd5-70c5c58e9363 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1729 microversion: 2.20 time: 0.232284 Jun 21 18:45:26.644396 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 524/1048] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:26 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1729 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:45:27.668450 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-87f3324c-9b84-49d3-88fe-4a92a7a49891 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:27.670775 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-87f3324c-9b84-49d3-88fe-4a92a7a49891 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:27.683928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-87f3324c-9b84-49d3-88fe-4a92a7a49891 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:27.684715 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-87f3324c-9b84-49d3-88fe-4a92a7a49891 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:27.686331 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-87f3324c-9b84-49d3-88fe-4a92a7a49891 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:27.687169 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-87f3324c-9b84-49d3-88fe-4a92a7a49891 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:27.933930 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-87f3324c-9b84-49d3-88fe-4a92a7a49891 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:27.948268 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-87f3324c-9b84-49d3-88fe-4a92a7a49891 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:27.950173 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-87f3324c-9b84-49d3-88fe-4a92a7a49891 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:27.951714 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-87f3324c-9b84-49d3-88fe-4a92a7a49891 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1729 microversion: 2.20 time: 0.292229 Jun 21 18:45:27.960745 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 525/1049] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:27 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1729 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:45:28.975403 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-542f0a28-09c7-41d3-8dc3-5cd6bcfd1e28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:28.977331 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-542f0a28-09c7-41d3-8dc3-5cd6bcfd1e28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:28.987917 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-542f0a28-09c7-41d3-8dc3-5cd6bcfd1e28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:28.988543 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-542f0a28-09c7-41d3-8dc3-5cd6bcfd1e28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:28.989846 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-542f0a28-09c7-41d3-8dc3-5cd6bcfd1e28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:28.990419 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-542f0a28-09c7-41d3-8dc3-5cd6bcfd1e28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:29.248689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-542f0a28-09c7-41d3-8dc3-5cd6bcfd1e28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:29.264648 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-542f0a28-09c7-41d3-8dc3-5cd6bcfd1e28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:29.268038 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-542f0a28-09c7-41d3-8dc3-5cd6bcfd1e28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:29.270352 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-542f0a28-09c7-41d3-8dc3-5cd6bcfd1e28 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1729 microversion: 2.20 time: 0.300636 Jun 21 18:45:29.271635 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 525/1050] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:28 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1729 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:30.304999 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-af167107-349f-4f8f-84ad-7399ae15d146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:30.306038 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-af167107-349f-4f8f-84ad-7399ae15d146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:30.318423 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-af167107-349f-4f8f-84ad-7399ae15d146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:30.319130 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-af167107-349f-4f8f-84ad-7399ae15d146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:30.320345 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-af167107-349f-4f8f-84ad-7399ae15d146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:30.321011 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-af167107-349f-4f8f-84ad-7399ae15d146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:30.555660 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-af167107-349f-4f8f-84ad-7399ae15d146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:30.570042 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-af167107-349f-4f8f-84ad-7399ae15d146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:30.572893 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-af167107-349f-4f8f-84ad-7399ae15d146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:30.575119 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-af167107-349f-4f8f-84ad-7399ae15d146 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1729 microversion: 2.20 time: 0.277536 Jun 21 18:45:30.576205 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 526/1051] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:30 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1729 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:31.596888 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-7480734d-1983-4d6d-b9c4-b53a2ce95c89 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:31.597604 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-7480734d-1983-4d6d-b9c4-b53a2ce95c89 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:31.605437 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7480734d-1983-4d6d-b9c4-b53a2ce95c89 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:31.606087 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7480734d-1983-4d6d-b9c4-b53a2ce95c89 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:31.606989 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7480734d-1983-4d6d-b9c4-b53a2ce95c89 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:31.607520 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7480734d-1983-4d6d-b9c4-b53a2ce95c89 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:31.772851 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-7480734d-1983-4d6d-b9c4-b53a2ce95c89 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:31.783800 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-7480734d-1983-4d6d-b9c4-b53a2ce95c89 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:31.787205 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-7480734d-1983-4d6d-b9c4-b53a2ce95c89 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:31.789244 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-7480734d-1983-4d6d-b9c4-b53a2ce95c89 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1729 microversion: 2.20 time: 0.196724 Jun 21 18:45:31.790191 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 526/1052] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:31 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 18:45:32.815182 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f3fe6cd1-54db-44ac-bb19-03a36b59b479 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:32.816863 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f3fe6cd1-54db-44ac-bb19-03a36b59b479 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:32.827167 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f3fe6cd1-54db-44ac-bb19-03a36b59b479 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:32.827696 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f3fe6cd1-54db-44ac-bb19-03a36b59b479 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:32.828501 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f3fe6cd1-54db-44ac-bb19-03a36b59b479 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:32.828936 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f3fe6cd1-54db-44ac-bb19-03a36b59b479 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:32.992169 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f3fe6cd1-54db-44ac-bb19-03a36b59b479 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:33.002062 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f3fe6cd1-54db-44ac-bb19-03a36b59b479 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:33.003584 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f3fe6cd1-54db-44ac-bb19-03a36b59b479 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:33.004806 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f3fe6cd1-54db-44ac-bb19-03a36b59b479 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1729 microversion: 2.20 time: 0.198930 Jun 21 18:45:33.005752 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 527/1053] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:32 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:34.024968 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c69fba6c-1db8-49ef-adc3-cc4383cf9d93 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:34.025704 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c69fba6c-1db8-49ef-adc3-cc4383cf9d93 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:34.033412 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c69fba6c-1db8-49ef-adc3-cc4383cf9d93 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:34.034174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c69fba6c-1db8-49ef-adc3-cc4383cf9d93 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:34.035164 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c69fba6c-1db8-49ef-adc3-cc4383cf9d93 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:34.035601 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c69fba6c-1db8-49ef-adc3-cc4383cf9d93 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:34.233362 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c69fba6c-1db8-49ef-adc3-cc4383cf9d93 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:34.256773 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c69fba6c-1db8-49ef-adc3-cc4383cf9d93 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:34.259368 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c69fba6c-1db8-49ef-adc3-cc4383cf9d93 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:34.261185 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c69fba6c-1db8-49ef-adc3-cc4383cf9d93 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1729 microversion: 2.20 time: 0.240596 Jun 21 18:45:34.262121 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 527/1054] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:34 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1729 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:35.281145 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f5399e67-c8bd-450c-994c-d53d9ae0a278 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:35.281973 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-f5399e67-c8bd-450c-994c-d53d9ae0a278 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:35.289956 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f5399e67-c8bd-450c-994c-d53d9ae0a278 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:35.290455 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f5399e67-c8bd-450c-994c-d53d9ae0a278 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:35.291247 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f5399e67-c8bd-450c-994c-d53d9ae0a278 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:35.291712 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-f5399e67-c8bd-450c-994c-d53d9ae0a278 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:35.455890 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f5399e67-c8bd-450c-994c-d53d9ae0a278 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:35.466122 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f5399e67-c8bd-450c-994c-d53d9ae0a278 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:35.467700 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-f5399e67-c8bd-450c-994c-d53d9ae0a278 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:35.469115 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f5399e67-c8bd-450c-994c-d53d9ae0a278 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1729 microversion: 2.20 time: 0.192446 Jun 21 18:45:35.469614 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 528/1055] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:35 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:36.488334 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-72254579-ad39-4d12-a06e-c8ed1d66bc69 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:36.489109 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-72254579-ad39-4d12-a06e-c8ed1d66bc69 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:36.496864 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-72254579-ad39-4d12-a06e-c8ed1d66bc69 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:36.497321 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-72254579-ad39-4d12-a06e-c8ed1d66bc69 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:36.498138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-72254579-ad39-4d12-a06e-c8ed1d66bc69 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:36.498570 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-72254579-ad39-4d12-a06e-c8ed1d66bc69 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:36.652304 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-72254579-ad39-4d12-a06e-c8ed1d66bc69 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:36.661402 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-72254579-ad39-4d12-a06e-c8ed1d66bc69 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:36.663794 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-72254579-ad39-4d12-a06e-c8ed1d66bc69 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:36.665039 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-72254579-ad39-4d12-a06e-c8ed1d66bc69 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1729 microversion: 2.20 time: 0.181100 Jun 21 18:45:36.666047 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 528/1056] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:36 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:37.697466 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-fc51cf5f-0609-46a4-91e0-cf4050cd62f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:37.698510 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-fc51cf5f-0609-46a4-91e0-cf4050cd62f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:37.710043 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fc51cf5f-0609-46a4-91e0-cf4050cd62f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:37.710654 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fc51cf5f-0609-46a4-91e0-cf4050cd62f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:37.712432 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fc51cf5f-0609-46a4-91e0-cf4050cd62f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:37.712432 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-fc51cf5f-0609-46a4-91e0-cf4050cd62f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:37.879716 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-fc51cf5f-0609-46a4-91e0-cf4050cd62f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:37.895094 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-fc51cf5f-0609-46a4-91e0-cf4050cd62f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:37.898340 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-fc51cf5f-0609-46a4-91e0-cf4050cd62f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:37.900493 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-fc51cf5f-0609-46a4-91e0-cf4050cd62f8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1729 microversion: 2.20 time: 0.207741 Jun 21 18:45:37.901523 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 529/1057] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:37 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:38.932102 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-0dc42f5f-9686-4230-9420-e49cf9020566 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:38.933012 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-0dc42f5f-9686-4230-9420-e49cf9020566 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:38.941199 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0dc42f5f-9686-4230-9420-e49cf9020566 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:38.941852 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0dc42f5f-9686-4230-9420-e49cf9020566 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:38.943027 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0dc42f5f-9686-4230-9420-e49cf9020566 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:38.943489 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-0dc42f5f-9686-4230-9420-e49cf9020566 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:39.124909 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-0dc42f5f-9686-4230-9420-e49cf9020566 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:39.137257 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-0dc42f5f-9686-4230-9420-e49cf9020566 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:39.139493 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-0dc42f5f-9686-4230-9420-e49cf9020566 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:39.140819 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-0dc42f5f-9686-4230-9420-e49cf9020566 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1729 microversion: 2.20 time: 0.214134 Jun 21 18:45:39.141395 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 529/1058] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:38 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1729 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:40.164451 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-90f440df-d2d8-46c4-9ef6-ebf69a248fdd tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:40.165429 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-90f440df-d2d8-46c4-9ef6-ebf69a248fdd tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:40.177464 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-90f440df-d2d8-46c4-9ef6-ebf69a248fdd tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:40.178275 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-90f440df-d2d8-46c4-9ef6-ebf69a248fdd tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:40.179687 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-90f440df-d2d8-46c4-9ef6-ebf69a248fdd tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:40.180414 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-90f440df-d2d8-46c4-9ef6-ebf69a248fdd tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:40.356680 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-90f440df-d2d8-46c4-9ef6-ebf69a248fdd tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:40.365985 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-90f440df-d2d8-46c4-9ef6-ebf69a248fdd tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:40.367793 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-90f440df-d2d8-46c4-9ef6-ebf69a248fdd tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:40.369120 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-90f440df-d2d8-46c4-9ef6-ebf69a248fdd tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1729 microversion: 2.20 time: 0.212304 Jun 21 18:45:40.369813 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 530/1059] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:40 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:41.389900 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-bed0c188-c603-43ec-9428-fd289f117c6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:41.390817 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-bed0c188-c603-43ec-9428-fd289f117c6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:41.401290 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bed0c188-c603-43ec-9428-fd289f117c6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:41.402129 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bed0c188-c603-43ec-9428-fd289f117c6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:41.403530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bed0c188-c603-43ec-9428-fd289f117c6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:41.404155 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bed0c188-c603-43ec-9428-fd289f117c6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:41.564988 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-bed0c188-c603-43ec-9428-fd289f117c6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:41.574839 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-bed0c188-c603-43ec-9428-fd289f117c6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:41.576384 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-bed0c188-c603-43ec-9428-fd289f117c6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:41.577655 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-bed0c188-c603-43ec-9428-fd289f117c6d tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1729 microversion: 2.20 time: 0.193002 Jun 21 18:45:41.578241 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 530/1060] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:41 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:42.605555 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-67685f0b-ead8-41dc-9e23-505bfefc5db2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:42.606464 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-67685f0b-ead8-41dc-9e23-505bfefc5db2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:42.614643 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-67685f0b-ead8-41dc-9e23-505bfefc5db2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:42.614990 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-67685f0b-ead8-41dc-9e23-505bfefc5db2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:42.615954 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-67685f0b-ead8-41dc-9e23-505bfefc5db2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:42.616424 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-67685f0b-ead8-41dc-9e23-505bfefc5db2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:42.773997 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-67685f0b-ead8-41dc-9e23-505bfefc5db2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:42.782892 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-67685f0b-ead8-41dc-9e23-505bfefc5db2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:42.784499 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-67685f0b-ead8-41dc-9e23-505bfefc5db2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:42.785792 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-67685f0b-ead8-41dc-9e23-505bfefc5db2 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1729 microversion: 2.20 time: 0.184414 Jun 21 18:45:42.786468 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 531/1061] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:42 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:43.127003 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-93f0e311-346c-4905-9e58-206ff6d1fc03 req-43389701-7d31-446a-b91e-bc290538263c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba08486-1cfb-443b-9e39-ba65962dd01e", "name": "network-vif-plugged", "status": "completed", "tag": "bffcf1ea-ece3-4130-9438-75fbde5fa0bf"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:45:43.144240 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-93f0e311-346c-4905-9e58-206ff6d1fc03 req-43389701-7d31-446a-b91e-bc290538263c service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:43.145187 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-93f0e311-346c-4905-9e58-206ff6d1fc03 req-43389701-7d31-446a-b91e-bc290538263c service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:43.168012 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-93f0e311-346c-4905-9e58-206ff6d1fc03 req-43389701-7d31-446a-b91e-bc290538263c service nova] Creating event network-vif-plugged:bffcf1ea-ece3-4130-9438-75fbde5fa0bf for instance 2ba08486-1cfb-443b-9e39-ba65962dd01e on hv-cinder-84460 Jun 21 18:45:43.179284 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-93f0e311-346c-4905-9e58-206ff6d1fc03 req-43389701-7d31-446a-b91e-bc290538263c service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057224 Jun 21 18:45:43.180880 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 531/1062] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:45:43.805830 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2ec51f54-08cf-417e-9743-7150175fa1bb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:43.806616 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-2ec51f54-08cf-417e-9743-7150175fa1bb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:43.815632 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2ec51f54-08cf-417e-9743-7150175fa1bb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:43.816395 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2ec51f54-08cf-417e-9743-7150175fa1bb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:43.818039 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2ec51f54-08cf-417e-9743-7150175fa1bb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:43.818607 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2ec51f54-08cf-417e-9743-7150175fa1bb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:43.989894 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2ec51f54-08cf-417e-9743-7150175fa1bb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:44.000465 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2ec51f54-08cf-417e-9743-7150175fa1bb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:44.002855 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2ec51f54-08cf-417e-9743-7150175fa1bb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:44.003928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-2ec51f54-08cf-417e-9743-7150175fa1bb tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1729 microversion: 2.20 time: 0.202773 Jun 21 18:45:44.004199 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 532/1063] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:43 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:45.029549 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-fb0ff9b1-4e71-42c5-99d6-7edbbe1da8fe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:45.030854 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-fb0ff9b1-4e71-42c5-99d6-7edbbe1da8fe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:45.042357 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fb0ff9b1-4e71-42c5-99d6-7edbbe1da8fe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:45.043042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fb0ff9b1-4e71-42c5-99d6-7edbbe1da8fe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:45.044280 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fb0ff9b1-4e71-42c5-99d6-7edbbe1da8fe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:45.045030 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-fb0ff9b1-4e71-42c5-99d6-7edbbe1da8fe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:45.231325 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-fb0ff9b1-4e71-42c5-99d6-7edbbe1da8fe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:45.242962 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-fb0ff9b1-4e71-42c5-99d6-7edbbe1da8fe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:45.244534 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-fb0ff9b1-4e71-42c5-99d6-7edbbe1da8fe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:45.245821 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-fb0ff9b1-4e71-42c5-99d6-7edbbe1da8fe tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1729 microversion: 2.20 time: 0.225359 Jun 21 18:45:45.246379 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 532/1064] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:45 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:46.266769 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1df61b6e-75ee-4a03-a2ae-872754178d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:46.267768 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1df61b6e-75ee-4a03-a2ae-872754178d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:46.275566 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1df61b6e-75ee-4a03-a2ae-872754178d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:46.276199 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1df61b6e-75ee-4a03-a2ae-872754178d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:46.277199 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1df61b6e-75ee-4a03-a2ae-872754178d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:46.277942 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1df61b6e-75ee-4a03-a2ae-872754178d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:46.281160 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:45:46.453356 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1df61b6e-75ee-4a03-a2ae-872754178d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:46.463114 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1df61b6e-75ee-4a03-a2ae-872754178d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:46.464773 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1df61b6e-75ee-4a03-a2ae-872754178d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:46.466216 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1df61b6e-75ee-4a03-a2ae-872754178d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1716 microversion: 2.20 time: 0.203974 Jun 21 18:45:46.466818 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 533/1065] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:45:46 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1716 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:45:58.303236 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b6a71a24-9501-4486-b225-b5aacf4f26dd tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:58.303963 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b6a71a24-9501-4486-b225-b5aacf4f26dd tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:58.306712 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=27 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:45:58.307461 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:45:58.318481 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b6a71a24-9501-4486-b225-b5aacf4f26dd tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:58.319269 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b6a71a24-9501-4486-b225-b5aacf4f26dd tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:58.320668 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b6a71a24-9501-4486-b225-b5aacf4f26dd tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:58.321456 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b6a71a24-9501-4486-b225-b5aacf4f26dd tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:58.374878 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b6a71a24-9501-4486-b225-b5aacf4f26dd tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Going to try to terminate instance {{(pid=118108) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:45:58.502646 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b6a71a24-9501-4486-b225-b5aacf4f26dd tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "DELETE /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 204 len: 0 microversion: 2.1 time: 0.206084 Jun 21 18:45:58.503986 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 533/1066] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:45:58 2022] DELETE /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:45:58.514552 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-eb4174bc-136d-4f63-a921-010bc7d9e0fe tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:58.515590 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-eb4174bc-136d-4f63-a921-010bc7d9e0fe tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:58.518743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=29 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:45:58.519548 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=5 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:45:58.527061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-eb4174bc-136d-4f63-a921-010bc7d9e0fe tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:58.527517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-eb4174bc-136d-4f63-a921-010bc7d9e0fe tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:58.528310 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-eb4174bc-136d-4f63-a921-010bc7d9e0fe tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:58.528743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-eb4174bc-136d-4f63-a921-010bc7d9e0fe tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:58.687594 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-eb4174bc-136d-4f63-a921-010bc7d9e0fe tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:58.702840 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-eb4174bc-136d-4f63-a921-010bc7d9e0fe tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1576 microversion: 2.1 time: 0.193427 Jun 21 18:45:58.703929 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 534/1067] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:45:58 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1576 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:45:59.731515 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b9f64b6d-4f8f-4834-88ad-c6f975d36509 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:45:59.732198 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b9f64b6d-4f8f-4834-88ad-c6f975d36509 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:45:59.739984 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b9f64b6d-4f8f-4834-88ad-c6f975d36509 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:59.740422 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b9f64b6d-4f8f-4834-88ad-c6f975d36509 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:59.741245 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b9f64b6d-4f8f-4834-88ad-c6f975d36509 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:45:59.741830 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b9f64b6d-4f8f-4834-88ad-c6f975d36509 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:45:59.913861 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-b9f64b6d-4f8f-4834-88ad-c6f975d36509 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:45:59.922538 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b9f64b6d-4f8f-4834-88ad-c6f975d36509 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1576 microversion: 2.1 time: 0.195257 Jun 21 18:45:59.923156 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 534/1068] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:45:59 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1576 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:00.946900 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a61dcb06-0991-4f7b-9e03-23c9818da3a4 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:00.948031 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-a61dcb06-0991-4f7b-9e03-23c9818da3a4 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:00.959181 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a61dcb06-0991-4f7b-9e03-23c9818da3a4 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:00.959971 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a61dcb06-0991-4f7b-9e03-23c9818da3a4 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:00.962370 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a61dcb06-0991-4f7b-9e03-23c9818da3a4 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:00.963148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a61dcb06-0991-4f7b-9e03-23c9818da3a4 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:01.152424 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-a61dcb06-0991-4f7b-9e03-23c9818da3a4 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:01.160818 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-a61dcb06-0991-4f7b-9e03-23c9818da3a4 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1576 microversion: 2.1 time: 0.222642 Jun 21 18:46:01.161897 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 535/1069] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:00 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1576 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:01.798577 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-46619520-0e02-4e61-89a6-dbebb1c47e66 req-79fc6769-010d-4011-885f-330e4745b6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7d8e4d2-7b70-415b-a82b-e217d55cef26", "name": "network-vif-deleted", "tag": "7554a426-600d-477b-9a71-f583c2065650"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:46:01.819653 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-46619520-0e02-4e61-89a6-dbebb1c47e66 req-79fc6769-010d-4011-885f-330e4745b6e3 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:01.820167 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-46619520-0e02-4e61-89a6-dbebb1c47e66 req-79fc6769-010d-4011-885f-330e4745b6e3 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:01.836469 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-46619520-0e02-4e61-89a6-dbebb1c47e66 req-79fc6769-010d-4011-885f-330e4745b6e3 service nova] Creating event network-vif-deleted:7554a426-600d-477b-9a71-f583c2065650 for instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 on hv-cinder-84460 Jun 21 18:46:01.843850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-46619520-0e02-4e61-89a6-dbebb1c47e66 req-79fc6769-010d-4011-885f-330e4745b6e3 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049832 Jun 21 18:46:01.845313 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 535/1070] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:46:02.180692 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-79850af9-a611-47b4-997c-a191c9ee7b7f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:02.181892 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-79850af9-a611-47b4-997c-a191c9ee7b7f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:02.189498 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-79850af9-a611-47b4-997c-a191c9ee7b7f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:02.189978 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-79850af9-a611-47b4-997c-a191c9ee7b7f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:02.191243 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-79850af9-a611-47b4-997c-a191c9ee7b7f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:02.191768 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-79850af9-a611-47b4-997c-a191c9ee7b7f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:02.270065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-79850af9-a611-47b4-997c-a191c9ee7b7f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:02.281091 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-79850af9-a611-47b4-997c-a191c9ee7b7f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 200 len: 1225 microversion: 2.1 time: 0.105143 Jun 21 18:46:02.282381 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 536/1071] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:02 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:03.312089 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5ecb58fb-503f-4956-92f8-8243c1b4c46b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:03.313708 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-5ecb58fb-503f-4956-92f8-8243c1b4c46b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:03.320849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5ecb58fb-503f-4956-92f8-8243c1b4c46b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:03.321268 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5ecb58fb-503f-4956-92f8-8243c1b4c46b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:03.322658 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5ecb58fb-503f-4956-92f8-8243c1b4c46b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:03.322884 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5ecb58fb-503f-4956-92f8-8243c1b4c46b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:03.340376 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-5ecb58fb-503f-4956-92f8-8243c1b4c46b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] HTTP exception thrown: Instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 could not be found. Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5ecb58fb-503f-4956-92f8-8243c1b4c46b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Request method failure captured: Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 HTTP/1.1 Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABishEe-MDGvAQhzWQKRSxv73kU_qtcPfKgh1r4ME4XIPHOi-6QWMmYt9-XxwyrbxZG3h4pEBr4xdx9vVUDwArTQEaBEEonZ9bfZeLaCBjust7KSIyOKLlbgDOXgs7s0sjz0SY1L-BqgbVFFsatNr3Wg7q-zW7dSWDL6yoe8c_1opK_3X4 Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 88c0ee0e3bda4c9b98c295af8718eff6 Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-TestVolumeBootPattern-477322311 Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:46:03.342752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:46:03.345938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:46:03.345938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-TestVolumeBootPattern-477322311 Jun 21 18:46:03.345938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 88c0ee0e3bda4c9b98c295af8718eff6 Jun 21 18:46:03.345938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-TestVolumeBootPattern-477322311 Jun 21 18:46:03.345938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-TestVolumeBootPattern-477322311-project Jun 21 18:46:03.345938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:46:03.345938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:46:03.345938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 0628da68245a42e4af2e16e42babc15a Jun 21 18:46:03.345938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-TestVolumeBootPattern-477322311-project Jun 21 18:46:03.345938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:46:03.345938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 could not be found. Jun 21 18:46:03.345938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': 'd7d8e4d2-7b70-415b-a82b-e217d55cef26'} Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 could not be found. Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:46:03.348028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:46:03.352182 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:46:03.352182 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:46:03.352182 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:46:03.352182 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:46:03.352182 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:46:03.352182 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:46:03.352182 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:46:03.352182 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 could not be found. Jun 21 18:46:03.352182 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:46:03.352182 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:46:03.352182 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:46:03.352182 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:46:03.352182 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:46:03.352182 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:46:03.352182 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:46:03.352182 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:46:03.352182 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 could not be found. Jun 21 18:46:03.352182 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:46:03.355796 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5ecb58fb-503f-4956-92f8-8243c1b4c46b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Returning 404 to user: Instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:46:03.355796 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-5ecb58fb-503f-4956-92f8-8243c1b4c46b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 404 len: 111 microversion: 2.1 time: 0.038566 Jun 21 18:46:03.355796 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 536/1072] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:03 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:46:03.418405 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1b615372-c6da-4711-99dc-4a422e1c0626 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1424078389", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-198007524", "security_groups": [{"name": "tempest-secgroup-smoke-179192695"}], "block_device_mapping_v2": [{"uuid": "4e15c809-5127-45be-9abf-663daa3e58eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a330634b-a2bf-4221-a2b7-6d2504bd49e4"}]}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:46:03.570857 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.network.neutron [None req-1b615372-c6da-4711-99dc-4a422e1c0626 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] validate_networks() for [('a330634b-a2bf-4221-a2b7-6d2504bd49e4', None, None, None, None, None)] {{(pid=118109) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:46:04.054307 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-1b615372-c6da-4711-99dc-4a422e1c0626 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Flavor limits 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:46:04.055080 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-1b615372-c6da-4711-99dc-4a422e1c0626 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Image limits 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:46:04.056107 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-1b615372-c6da-4711-99dc-4a422e1c0626 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Flavor pref 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:46:04.057916 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-1b615372-c6da-4711-99dc-4a422e1c0626 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Image pref 0:0:0 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:46:04.058603 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.virt.hardware [None req-1b615372-c6da-4711-99dc-4a422e1c0626 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118109) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:46:04.075564 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b615372-c6da-4711-99dc-4a422e1c0626 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:04.076347 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b615372-c6da-4711-99dc-4a422e1c0626 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:04.077801 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b615372-c6da-4711-99dc-4a422e1c0626 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:04.078571 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1b615372-c6da-4711-99dc-4a422e1c0626 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:04.106744 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-1b615372-c6da-4711-99dc-4a422e1c0626 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Getting quotas for project 88c0ee0e3bda4c9b98c295af8718eff6. Resources: {'instances', 'ram', 'cores'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:46:04.111320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.quota [None req-1b615372-c6da-4711-99dc-4a422e1c0626 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Getting quotas for user 0628da68245a42e4af2e16e42babc15a and project 88c0ee0e3bda4c9b98c295af8718eff6. Resources: {'instances', 'ram', 'cores'} {{(pid=118109) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:46:04.174061 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1b615372-c6da-4711-99dc-4a422e1c0626 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Going to run 1 instances... {{(pid=118109) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:46:04.176199 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1b615372-c6da-4711-99dc-4a422e1c0626 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4e15c809-5127-45be-9abf-663daa3e58eb',volume_size=None,volume_type=None)] {{(pid=118109) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:46:04.345014 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1b615372-c6da-4711-99dc-4a422e1c0626 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.934004 Jun 21 18:46:04.345995 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 537/1073] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:46:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 18:46:04.356867 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-62bed63e-bce5-4e56-92bb-943a21840a18 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:04.357629 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-62bed63e-bce5-4e56-92bb-943a21840a18 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:04.451518 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-62bed63e-bce5-4e56-92bb-943a21840a18 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:04.459085 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-62bed63e-bce5-4e56-92bb-943a21840a18 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1094 microversion: 2.1 time: 0.106649 Jun 21 18:46:04.459650 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 537/1074] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:04 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1094 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:05.478823 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-17a1eda3-7647-46e8-b4df-0674f3f1c2a7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:05.479540 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-17a1eda3-7647-46e8-b4df-0674f3f1c2a7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:05.538388 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-17a1eda3-7647-46e8-b4df-0674f3f1c2a7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:05.546867 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-17a1eda3-7647-46e8-b4df-0674f3f1c2a7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1094 microversion: 2.1 time: 0.073440 Jun 21 18:46:05.547439 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 538/1075] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:05 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:06.564757 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a203bab4-fad6-40e2-9a90-a33bc3525323 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:06.565528 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-a203bab4-fad6-40e2-9a90-a33bc3525323 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:06.574793 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a203bab4-fad6-40e2-9a90-a33bc3525323 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:06.575238 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a203bab4-fad6-40e2-9a90-a33bc3525323 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:06.576141 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a203bab4-fad6-40e2-9a90-a33bc3525323 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:06.576603 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a203bab4-fad6-40e2-9a90-a33bc3525323 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:06.645180 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-a203bab4-fad6-40e2-9a90-a33bc3525323 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:06.653789 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a203bab4-fad6-40e2-9a90-a33bc3525323 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1144 microversion: 2.1 time: 0.092858 Jun 21 18:46:06.654346 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 538/1076] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:06 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:07.672731 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-d2e2dac2-1ecf-47d0-a5af-e5bfbbc497cd tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:07.673413 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-d2e2dac2-1ecf-47d0-a5af-e5bfbbc497cd tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:07.683472 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d2e2dac2-1ecf-47d0-a5af-e5bfbbc497cd tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:07.684197 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d2e2dac2-1ecf-47d0-a5af-e5bfbbc497cd tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:07.685565 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d2e2dac2-1ecf-47d0-a5af-e5bfbbc497cd tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:07.686386 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-d2e2dac2-1ecf-47d0-a5af-e5bfbbc497cd tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:07.772123 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-d2e2dac2-1ecf-47d0-a5af-e5bfbbc497cd tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:07.789797 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-d2e2dac2-1ecf-47d0-a5af-e5bfbbc497cd tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1210 microversion: 2.1 time: 0.120508 Jun 21 18:46:07.791364 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 539/1077] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:07 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1210 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:08.820282 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-32f95fed-0d42-4088-9d65-245df7cb6c0e tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:08.821444 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-32f95fed-0d42-4088-9d65-245df7cb6c0e tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:08.834992 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-32f95fed-0d42-4088-9d65-245df7cb6c0e tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:08.835782 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-32f95fed-0d42-4088-9d65-245df7cb6c0e tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:08.837183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-32f95fed-0d42-4088-9d65-245df7cb6c0e tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:08.838003 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-32f95fed-0d42-4088-9d65-245df7cb6c0e tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:09.030633 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-32f95fed-0d42-4088-9d65-245df7cb6c0e tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:09.041798 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-32f95fed-0d42-4088-9d65-245df7cb6c0e tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1265 microversion: 2.1 time: 0.228952 Jun 21 18:46:09.053090 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 539/1078] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:08 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:09.160684 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-0fd37608-4ec8-49e0-ba8a-9cc66fe36db5 req-e41ba6ea-8828-4c0f-b83c-246ebfbcf486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "162493b0-54de-4244-b8a9-ec822fc97719", "tag": "31430c9b-bd60-4aca-80ff-3448ee48500b"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:46:09.172659 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-0fd37608-4ec8-49e0-ba8a-9cc66fe36db5 req-e41ba6ea-8828-4c0f-b83c-246ebfbcf486 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:09.173114 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-0fd37608-4ec8-49e0-ba8a-9cc66fe36db5 req-e41ba6ea-8828-4c0f-b83c-246ebfbcf486 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:09.188027 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-0fd37608-4ec8-49e0-ba8a-9cc66fe36db5 req-e41ba6ea-8828-4c0f-b83c-246ebfbcf486 service nova] Creating event network-changed:31430c9b-bd60-4aca-80ff-3448ee48500b for instance 162493b0-54de-4244-b8a9-ec822fc97719 on hv-cinder-84460 Jun 21 18:46:09.191928 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR oslo.messaging._drivers.impl_rabbit [req-0fd37608-4ec8-49e0-ba8a-9cc66fe36db5 req-e41ba6ea-8828-4c0f-b83c-246ebfbcf486 service nova] [b0e850e9-f477-4e13-afff-e5338d6b1c9e] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 21 18:46:10.066679 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c39ca46c-300f-4df1-b4b0-27a10971b91a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:10.067327 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c39ca46c-300f-4df1-b4b0-27a10971b91a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:10.074883 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c39ca46c-300f-4df1-b4b0-27a10971b91a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:10.075479 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c39ca46c-300f-4df1-b4b0-27a10971b91a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:10.076371 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c39ca46c-300f-4df1-b4b0-27a10971b91a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:10.076898 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c39ca46c-300f-4df1-b4b0-27a10971b91a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:10.205007 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO oslo.messaging._drivers.impl_rabbit [req-0fd37608-4ec8-49e0-ba8a-9cc66fe36db5 req-e41ba6ea-8828-4c0f-b83c-246ebfbcf486 service nova] [b0e850e9-f477-4e13-afff-e5338d6b1c9e] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 49064. Jun 21 18:46:10.211103 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-0fd37608-4ec8-49e0-ba8a-9cc66fe36db5 req-e41ba6ea-8828-4c0f-b83c-246ebfbcf486 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.059710 Jun 21 18:46:10.212522 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 540/1079] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:46:10.259199 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c39ca46c-300f-4df1-b4b0-27a10971b91a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:10.268009 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c39ca46c-300f-4df1-b4b0-27a10971b91a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1265 microversion: 2.1 time: 0.205122 Jun 21 18:46:10.268596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 540/1080] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:10 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:11.287849 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1c6f9710-ef88-40de-b6da-4655e7801a53 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:11.288592 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1c6f9710-ef88-40de-b6da-4655e7801a53 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:11.296431 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1c6f9710-ef88-40de-b6da-4655e7801a53 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:11.296879 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1c6f9710-ef88-40de-b6da-4655e7801a53 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:11.297942 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1c6f9710-ef88-40de-b6da-4655e7801a53 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:11.298390 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1c6f9710-ef88-40de-b6da-4655e7801a53 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:11.467487 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1c6f9710-ef88-40de-b6da-4655e7801a53 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:11.475917 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1c6f9710-ef88-40de-b6da-4655e7801a53 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1265 microversion: 2.1 time: 0.193181 Jun 21 18:46:11.476493 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 541/1081] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:11 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:12.506600 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-cea05b7a-b4b2-471d-bee7-f738c5430bf7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:12.507631 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-cea05b7a-b4b2-471d-bee7-f738c5430bf7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:12.521400 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cea05b7a-b4b2-471d-bee7-f738c5430bf7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:12.521871 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cea05b7a-b4b2-471d-bee7-f738c5430bf7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:12.523368 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cea05b7a-b4b2-471d-bee7-f738c5430bf7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:12.524174 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-cea05b7a-b4b2-471d-bee7-f738c5430bf7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:12.699325 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-cea05b7a-b4b2-471d-bee7-f738c5430bf7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:12.711105 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-cea05b7a-b4b2-471d-bee7-f738c5430bf7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1265 microversion: 2.1 time: 0.211527 Jun 21 18:46:12.712388 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 541/1082] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:12 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:13.737615 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1c00415e-f528-4f14-99f1-c224004b379c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:13.738328 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1c00415e-f528-4f14-99f1-c224004b379c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:13.749045 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1c00415e-f528-4f14-99f1-c224004b379c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:13.749855 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1c00415e-f528-4f14-99f1-c224004b379c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:13.750835 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1c00415e-f528-4f14-99f1-c224004b379c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:13.751418 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1c00415e-f528-4f14-99f1-c224004b379c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:13.949846 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1c00415e-f528-4f14-99f1-c224004b379c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:13.959357 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1c00415e-f528-4f14-99f1-c224004b379c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1265 microversion: 2.1 time: 0.225805 Jun 21 18:46:13.959961 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 542/1083] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:13 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:14.983754 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f19eaa2c-9b9b-4a6f-a692-c2c3c491361c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:14.984502 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f19eaa2c-9b9b-4a6f-a692-c2c3c491361c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:14.987576 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=2 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:46:14.995086 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f19eaa2c-9b9b-4a6f-a692-c2c3c491361c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:14.995527 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f19eaa2c-9b9b-4a6f-a692-c2c3c491361c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:14.996304 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f19eaa2c-9b9b-4a6f-a692-c2c3c491361c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:14.996784 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f19eaa2c-9b9b-4a6f-a692-c2c3c491361c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:15.158186 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f19eaa2c-9b9b-4a6f-a692-c2c3c491361c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:15.167090 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f19eaa2c-9b9b-4a6f-a692-c2c3c491361c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1265 microversion: 2.1 time: 0.187392 Jun 21 18:46:15.167673 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 542/1084] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:14 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:15.319703 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-07db73ac-fbd1-4471-abda-115fd365c0a2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:46:15.320349 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-07db73ac-fbd1-4471-abda-115fd365c0a2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:15.322309 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=2 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:46:15.329182 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-07db73ac-fbd1-4471-abda-115fd365c0a2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:15.329629 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-07db73ac-fbd1-4471-abda-115fd365c0a2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:15.330479 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-07db73ac-fbd1-4471-abda-115fd365c0a2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:15.330913 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-07db73ac-fbd1-4471-abda-115fd365c0a2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:15.372978 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.objects.instance [None req-07db73ac-fbd1-4471-abda-115fd365c0a2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lazy-loading 'flavor' on Instance uuid 7c5acc09-82a3-4cb4-9c04-f582cf629c63 {{(pid=118109) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:46:15.491210 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-07db73ac-fbd1-4471-abda-115fd365c0a2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "POST /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63/action" status: 202 len: 0 microversion: 2.1 time: 0.175469 Jun 21 18:46:15.491992 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 543/1085] 10.222.0.87 () {60 vars in 1277 bytes} [Tue Jun 21 18:46:15 2022] POST /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:46:15.508006 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4d19199b-1f0d-4ee3-8a70-09c4c45ac658 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:15.509408 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4d19199b-1f0d-4ee3-8a70-09c4c45ac658 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:15.524539 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4d19199b-1f0d-4ee3-8a70-09c4c45ac658 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:15.525361 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4d19199b-1f0d-4ee3-8a70-09c4c45ac658 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:15.526467 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4d19199b-1f0d-4ee3-8a70-09c4c45ac658 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:15.526910 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4d19199b-1f0d-4ee3-8a70-09c4c45ac658 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:15.714004 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-4d19199b-1f0d-4ee3-8a70-09c4c45ac658 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:15.726726 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4d19199b-1f0d-4ee3-8a70-09c4c45ac658 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1568 microversion: 2.1 time: 0.227296 Jun 21 18:46:15.727465 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 543/1086] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:15 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:16.184870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=8 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:46:16.191142 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bff5af96-24b3-4f4a-bf2b-5c4660eb3f48 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:16.191930 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-bff5af96-24b3-4f4a-bf2b-5c4660eb3f48 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:16.200840 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bff5af96-24b3-4f4a-bf2b-5c4660eb3f48 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:16.201333 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bff5af96-24b3-4f4a-bf2b-5c4660eb3f48 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:16.202294 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bff5af96-24b3-4f4a-bf2b-5c4660eb3f48 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:16.202763 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bff5af96-24b3-4f4a-bf2b-5c4660eb3f48 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:16.416139 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-bff5af96-24b3-4f4a-bf2b-5c4660eb3f48 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:16.425246 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-bff5af96-24b3-4f4a-bf2b-5c4660eb3f48 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1265 microversion: 2.1 time: 0.241979 Jun 21 18:46:16.426015 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 544/1087] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:16 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:16.749865 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-e33738ab-735d-4bef-a2e1-80b5371e7d39 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:16.750741 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-e33738ab-735d-4bef-a2e1-80b5371e7d39 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:16.762198 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e33738ab-735d-4bef-a2e1-80b5371e7d39 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:16.762960 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e33738ab-735d-4bef-a2e1-80b5371e7d39 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:16.764308 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e33738ab-735d-4bef-a2e1-80b5371e7d39 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:16.765051 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-e33738ab-735d-4bef-a2e1-80b5371e7d39 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:16.955317 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-e33738ab-735d-4bef-a2e1-80b5371e7d39 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:16.970438 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-e33738ab-735d-4bef-a2e1-80b5371e7d39 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1568 microversion: 2.1 time: 0.225828 Jun 21 18:46:16.971535 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 544/1088] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:16 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:17.445471 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e21e0ae0-ea3e-47d2-bfcb-f48c47015400 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:17.446333 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e21e0ae0-ea3e-47d2-bfcb-f48c47015400 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:17.452600 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e21e0ae0-ea3e-47d2-bfcb-f48c47015400 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:17.453039 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e21e0ae0-ea3e-47d2-bfcb-f48c47015400 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:17.453868 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e21e0ae0-ea3e-47d2-bfcb-f48c47015400 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:17.454292 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e21e0ae0-ea3e-47d2-bfcb-f48c47015400 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:17.614924 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e21e0ae0-ea3e-47d2-bfcb-f48c47015400 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:17.629182 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e21e0ae0-ea3e-47d2-bfcb-f48c47015400 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1265 microversion: 2.1 time: 0.188013 Jun 21 18:46:17.630276 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 545/1089] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:17 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:17.995693 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f71370eb-2e72-4614-8fa1-0e9abd4df369 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:17.996650 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f71370eb-2e72-4614-8fa1-0e9abd4df369 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:18.008191 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f71370eb-2e72-4614-8fa1-0e9abd4df369 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:18.008907 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f71370eb-2e72-4614-8fa1-0e9abd4df369 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:18.010173 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f71370eb-2e72-4614-8fa1-0e9abd4df369 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:18.011197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f71370eb-2e72-4614-8fa1-0e9abd4df369 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:18.217959 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f71370eb-2e72-4614-8fa1-0e9abd4df369 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:18.230555 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f71370eb-2e72-4614-8fa1-0e9abd4df369 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1568 microversion: 2.1 time: 0.242079 Jun 21 18:46:18.231567 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 545/1090] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:17 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:18.648585 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e3cec82f-ce7c-4571-a9b6-c88c6c638134 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:18.649375 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e3cec82f-ce7c-4571-a9b6-c88c6c638134 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:18.656588 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e3cec82f-ce7c-4571-a9b6-c88c6c638134 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:18.657062 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e3cec82f-ce7c-4571-a9b6-c88c6c638134 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:18.657864 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e3cec82f-ce7c-4571-a9b6-c88c6c638134 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:18.658301 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e3cec82f-ce7c-4571-a9b6-c88c6c638134 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:18.806245 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e3cec82f-ce7c-4571-a9b6-c88c6c638134 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:18.814458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e3cec82f-ce7c-4571-a9b6-c88c6c638134 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1265 microversion: 2.1 time: 0.169979 Jun 21 18:46:18.815047 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 546/1091] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:18 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:19.254875 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-038467fa-4764-43d9-b999-181698725e88 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:19.255580 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-038467fa-4764-43d9-b999-181698725e88 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:19.263304 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-038467fa-4764-43d9-b999-181698725e88 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:19.263756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-038467fa-4764-43d9-b999-181698725e88 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:19.264576 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-038467fa-4764-43d9-b999-181698725e88 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:19.265016 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-038467fa-4764-43d9-b999-181698725e88 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:19.331603 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-68c76210-acdc-4b8d-8e1d-5cd72d3e609a req-07fb96db-ecc6-4121-bc45-71b7826a5f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "162493b0-54de-4244-b8a9-ec822fc97719", "name": "network-vif-plugged", "status": "completed", "tag": "31430c9b-bd60-4aca-80ff-3448ee48500b"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:46:19.343095 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-68c76210-acdc-4b8d-8e1d-5cd72d3e609a req-07fb96db-ecc6-4121-bc45-71b7826a5f9b service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:19.343537 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-68c76210-acdc-4b8d-8e1d-5cd72d3e609a req-07fb96db-ecc6-4121-bc45-71b7826a5f9b service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:19.357960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-68c76210-acdc-4b8d-8e1d-5cd72d3e609a req-07fb96db-ecc6-4121-bc45-71b7826a5f9b service nova] Creating event network-vif-plugged:31430c9b-bd60-4aca-80ff-3448ee48500b for instance 162493b0-54de-4244-b8a9-ec822fc97719 on hv-cinder-84460 Jun 21 18:46:19.364663 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-68c76210-acdc-4b8d-8e1d-5cd72d3e609a req-07fb96db-ecc6-4121-bc45-71b7826a5f9b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036413 Jun 21 18:46:19.365546 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 547/1092] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:46:19.467984 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-038467fa-4764-43d9-b999-181698725e88 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:19.482835 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-038467fa-4764-43d9-b999-181698725e88 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1568 microversion: 2.1 time: 0.232803 Jun 21 18:46:19.483860 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 546/1093] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:19 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:19.834472 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a2ff682c-5c7d-4c00-afff-9429f687a434 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:19.835183 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-a2ff682c-5c7d-4c00-afff-9429f687a434 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:19.842824 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a2ff682c-5c7d-4c00-afff-9429f687a434 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:19.843272 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a2ff682c-5c7d-4c00-afff-9429f687a434 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:19.844069 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a2ff682c-5c7d-4c00-afff-9429f687a434 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:19.844510 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a2ff682c-5c7d-4c00-afff-9429f687a434 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:19.992959 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-a2ff682c-5c7d-4c00-afff-9429f687a434 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:20.001450 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-a2ff682c-5c7d-4c00-afff-9429f687a434 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1265 microversion: 2.1 time: 0.172386 Jun 21 18:46:20.002068 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 548/1094] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:19 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:20.507166 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-dc4ad4d6-ebbe-456d-836e-5ada5889e6f4 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:20.507823 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-dc4ad4d6-ebbe-456d-836e-5ada5889e6f4 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:20.516316 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dc4ad4d6-ebbe-456d-836e-5ada5889e6f4 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:20.516751 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dc4ad4d6-ebbe-456d-836e-5ada5889e6f4 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:20.517552 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dc4ad4d6-ebbe-456d-836e-5ada5889e6f4 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:20.518029 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-dc4ad4d6-ebbe-456d-836e-5ada5889e6f4 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:20.691920 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-dc4ad4d6-ebbe-456d-836e-5ada5889e6f4 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:20.705873 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-dc4ad4d6-ebbe-456d-836e-5ada5889e6f4 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1568 microversion: 2.1 time: 0.202190 Jun 21 18:46:20.706907 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 547/1095] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:20 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:21.028503 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-06bec27a-deb9-445b-8228-54ac037eaae1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:21.029300 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-06bec27a-deb9-445b-8228-54ac037eaae1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:21.036675 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-06bec27a-deb9-445b-8228-54ac037eaae1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:21.037127 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-06bec27a-deb9-445b-8228-54ac037eaae1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:21.037976 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-06bec27a-deb9-445b-8228-54ac037eaae1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:21.038451 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-06bec27a-deb9-445b-8228-54ac037eaae1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:21.221089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-06bec27a-deb9-445b-8228-54ac037eaae1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:21.229925 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-06bec27a-deb9-445b-8228-54ac037eaae1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1265 microversion: 2.1 time: 0.206134 Jun 21 18:46:21.230527 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 549/1096] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:21 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:21.732567 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a2e194d3-f418-448b-b73c-481689aec2be tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:21.733415 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-a2e194d3-f418-448b-b73c-481689aec2be tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:21.740581 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a2e194d3-f418-448b-b73c-481689aec2be tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:21.740996 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a2e194d3-f418-448b-b73c-481689aec2be tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:21.741844 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a2e194d3-f418-448b-b73c-481689aec2be tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:21.742273 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a2e194d3-f418-448b-b73c-481689aec2be tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:21.898668 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-a2e194d3-f418-448b-b73c-481689aec2be tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:21.911446 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a2e194d3-f418-448b-b73c-481689aec2be tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1568 microversion: 2.1 time: 0.182787 Jun 21 18:46:21.912147 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 548/1097] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:21 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:22.248994 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-05c370d6-fd61-49a6-83eb-853b3a2c4152 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:22.250152 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-05c370d6-fd61-49a6-83eb-853b3a2c4152 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:22.257871 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-05c370d6-fd61-49a6-83eb-853b3a2c4152 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:22.258643 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-05c370d6-fd61-49a6-83eb-853b3a2c4152 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:22.259388 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-05c370d6-fd61-49a6-83eb-853b3a2c4152 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:22.259831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-05c370d6-fd61-49a6-83eb-853b3a2c4152 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:22.423453 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-05c370d6-fd61-49a6-83eb-853b3a2c4152 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:22.432672 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-05c370d6-fd61-49a6-83eb-853b3a2c4152 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1451 microversion: 2.1 time: 0.188593 Jun 21 18:46:22.433266 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 550/1098] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:22 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1451 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:46:22.449884 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b2e7cef2-f9e3-4d35-b7ce-ccf8157581cb tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:22.450504 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b2e7cef2-f9e3-4d35-b7ce-ccf8157581cb tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:22.458869 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b2e7cef2-f9e3-4d35-b7ce-ccf8157581cb tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:22.459331 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b2e7cef2-f9e3-4d35-b7ce-ccf8157581cb tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:22.460125 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b2e7cef2-f9e3-4d35-b7ce-ccf8157581cb tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:22.460557 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b2e7cef2-f9e3-4d35-b7ce-ccf8157581cb tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:22.610777 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-b2e7cef2-f9e3-4d35-b7ce-ccf8157581cb tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:22.620229 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b2e7cef2-f9e3-4d35-b7ce-ccf8157581cb tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1451 microversion: 2.1 time: 0.174223 Jun 21 18:46:22.620818 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 549/1099] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:22 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1451 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:22.932534 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c1096e29-fed1-4b65-9718-50ff86021c06 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:22.933273 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c1096e29-fed1-4b65-9718-50ff86021c06 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:22.940375 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c1096e29-fed1-4b65-9718-50ff86021c06 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:22.940879 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c1096e29-fed1-4b65-9718-50ff86021c06 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:22.941612 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c1096e29-fed1-4b65-9718-50ff86021c06 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:22.942180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c1096e29-fed1-4b65-9718-50ff86021c06 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:22.964605 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:46:23.101673 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c1096e29-fed1-4b65-9718-50ff86021c06 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:23.110092 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c1096e29-fed1-4b65-9718-50ff86021c06 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1568 microversion: 2.1 time: 0.181342 Jun 21 18:46:23.110665 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 551/1100] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:22 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:24.129108 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a39c1b23-0dda-46e6-8abf-e39c4f9fe701 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:24.130006 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-a39c1b23-0dda-46e6-8abf-e39c4f9fe701 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:24.137879 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a39c1b23-0dda-46e6-8abf-e39c4f9fe701 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:24.138337 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a39c1b23-0dda-46e6-8abf-e39c4f9fe701 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:24.139154 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a39c1b23-0dda-46e6-8abf-e39c4f9fe701 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:24.139627 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a39c1b23-0dda-46e6-8abf-e39c4f9fe701 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:24.144452 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:46:24.334778 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-a39c1b23-0dda-46e6-8abf-e39c4f9fe701 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:24.348042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a39c1b23-0dda-46e6-8abf-e39c4f9fe701 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1568 microversion: 2.1 time: 0.223230 Jun 21 18:46:24.349217 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 550/1101] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:24 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:24.874521 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-d5d5fe93-46ec-4efe-b4e8-58f304d0bafb req-f2ff473c-b248-4a66-a280-14fc4487d60e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "162493b0-54de-4244-b8a9-ec822fc97719", "tag": "31430c9b-bd60-4aca-80ff-3448ee48500b"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:46:24.884912 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-d5d5fe93-46ec-4efe-b4e8-58f304d0bafb req-f2ff473c-b248-4a66-a280-14fc4487d60e service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:24.885541 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-d5d5fe93-46ec-4efe-b4e8-58f304d0bafb req-f2ff473c-b248-4a66-a280-14fc4487d60e service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:24.899745 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-d5d5fe93-46ec-4efe-b4e8-58f304d0bafb req-f2ff473c-b248-4a66-a280-14fc4487d60e service nova] Creating event network-changed:31430c9b-bd60-4aca-80ff-3448ee48500b for instance 162493b0-54de-4244-b8a9-ec822fc97719 on hv-cinder-84460 Jun 21 18:46:24.907435 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-d5d5fe93-46ec-4efe-b4e8-58f304d0bafb req-f2ff473c-b248-4a66-a280-14fc4487d60e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036273 Jun 21 18:46:24.908517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 552/1102] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:46:25.368201 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-91dd5dda-a69f-466c-98e6-41dea833ab00 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:25.370005 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-91dd5dda-a69f-466c-98e6-41dea833ab00 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:25.382276 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-91dd5dda-a69f-466c-98e6-41dea833ab00 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:25.383183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-91dd5dda-a69f-466c-98e6-41dea833ab00 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:25.384552 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-91dd5dda-a69f-466c-98e6-41dea833ab00 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:25.385298 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-91dd5dda-a69f-466c-98e6-41dea833ab00 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:25.592434 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-91dd5dda-a69f-466c-98e6-41dea833ab00 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:25.609270 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-91dd5dda-a69f-466c-98e6-41dea833ab00 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1568 microversion: 2.1 time: 0.245609 Jun 21 18:46:25.610361 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 551/1103] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:25 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:26.629790 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-01095a2f-b7dd-4045-bbab-7f86bc090fed tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:26.631108 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-01095a2f-b7dd-4045-bbab-7f86bc090fed tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:26.638553 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-01095a2f-b7dd-4045-bbab-7f86bc090fed tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:26.639057 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-01095a2f-b7dd-4045-bbab-7f86bc090fed tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:26.639878 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-01095a2f-b7dd-4045-bbab-7f86bc090fed tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:26.640362 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-01095a2f-b7dd-4045-bbab-7f86bc090fed tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:26.824911 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-01095a2f-b7dd-4045-bbab-7f86bc090fed tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:26.833820 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-01095a2f-b7dd-4045-bbab-7f86bc090fed tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1568 microversion: 2.1 time: 0.209146 Jun 21 18:46:26.834422 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 553/1104] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:26 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:26.971601 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:46:26.972266 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Tue Jun 21 18:46:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:46:27.852881 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d4118c80-6e74-4a4b-abe9-ee4b86a96009 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:27.853514 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-d4118c80-6e74-4a4b-abe9-ee4b86a96009 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:27.860998 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d4118c80-6e74-4a4b-abe9-ee4b86a96009 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:27.861441 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d4118c80-6e74-4a4b-abe9-ee4b86a96009 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:27.862246 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d4118c80-6e74-4a4b-abe9-ee4b86a96009 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:27.862673 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d4118c80-6e74-4a4b-abe9-ee4b86a96009 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:28.018374 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-d4118c80-6e74-4a4b-abe9-ee4b86a96009 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:28.028283 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-d4118c80-6e74-4a4b-abe9-ee4b86a96009 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1568 microversion: 2.1 time: 0.179881 Jun 21 18:46:28.028888 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 552/1105] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:27 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:29.046537 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-07e8bb66-61a6-4099-99dd-375503c9d852 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:29.047300 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-07e8bb66-61a6-4099-99dd-375503c9d852 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:29.049848 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:46:29.057010 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-07e8bb66-61a6-4099-99dd-375503c9d852 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:29.057527 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-07e8bb66-61a6-4099-99dd-375503c9d852 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:29.058387 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-07e8bb66-61a6-4099-99dd-375503c9d852 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:29.058829 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-07e8bb66-61a6-4099-99dd-375503c9d852 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:29.226602 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-07e8bb66-61a6-4099-99dd-375503c9d852 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:29.235655 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-07e8bb66-61a6-4099-99dd-375503c9d852 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1509 microversion: 2.1 time: 0.193542 Jun 21 18:46:29.236301 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 554/1106] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:29 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1509 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:46:29.254411 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-df334ceb-bb6a-4996-9a4b-bae837b25a15 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:46:29.255648 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-df334ceb-bb6a-4996-9a4b-bae837b25a15 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:29.258197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:46:29.264557 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-df334ceb-bb6a-4996-9a4b-bae837b25a15 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:29.264994 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-df334ceb-bb6a-4996-9a4b-bae837b25a15 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:29.265815 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-df334ceb-bb6a-4996-9a4b-bae837b25a15 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:29.266247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-df334ceb-bb6a-4996-9a4b-bae837b25a15 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:29.374456 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-df334ceb-bb6a-4996-9a4b-bae837b25a15 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "POST /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63/action" status: 202 len: 0 microversion: 2.1 time: 0.124319 Jun 21 18:46:29.375138 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 553/1107] 10.222.0.87 () {60 vars in 1277 bytes} [Tue Jun 21 18:46:29 2022] POST /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:46:29.384723 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-2a3f4066-3f61-4ae7-ac49-686ff87a84b7 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:29.385451 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-2a3f4066-3f61-4ae7-ac49-686ff87a84b7 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:29.393746 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2a3f4066-3f61-4ae7-ac49-686ff87a84b7 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:29.394385 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2a3f4066-3f61-4ae7-ac49-686ff87a84b7 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:29.395459 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2a3f4066-3f61-4ae7-ac49-686ff87a84b7 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:29.396216 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-2a3f4066-3f61-4ae7-ac49-686ff87a84b7 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:29.631113 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-2a3f4066-3f61-4ae7-ac49-686ff87a84b7 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:29.643763 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-2a3f4066-3f61-4ae7-ac49-686ff87a84b7 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1517 microversion: 2.1 time: 0.263709 Jun 21 18:46:29.644557 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 555/1108] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:29 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1517 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:46:30.664466 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-4e9635ff-f599-4b6a-8094-6b46e2333b7a tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:30.665073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-4e9635ff-f599-4b6a-8094-6b46e2333b7a tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:30.674013 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4e9635ff-f599-4b6a-8094-6b46e2333b7a tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:30.674539 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4e9635ff-f599-4b6a-8094-6b46e2333b7a tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:30.675493 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4e9635ff-f599-4b6a-8094-6b46e2333b7a tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:30.675985 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-4e9635ff-f599-4b6a-8094-6b46e2333b7a tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:30.889937 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-4e9635ff-f599-4b6a-8094-6b46e2333b7a tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:30.898940 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-4e9635ff-f599-4b6a-8094-6b46e2333b7a tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1519 microversion: 2.1 time: 0.240111 Jun 21 18:46:30.899530 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 554/1109] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:30 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1519 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:31.423432 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-7870a436-4cb3-42d9-83a9-2ddb5cf445fa req-3aaa2d95-225b-45e8-88e9-f11edd45193f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c5acc09-82a3-4cb4-9c04-f582cf629c63", "name": "network-vif-unplugged", "status": "completed", "tag": "8410643e-d59e-415c-b889-359fc6fba852"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:46:31.437940 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-7870a436-4cb3-42d9-83a9-2ddb5cf445fa req-3aaa2d95-225b-45e8-88e9-f11edd45193f service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:31.438714 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-7870a436-4cb3-42d9-83a9-2ddb5cf445fa req-3aaa2d95-225b-45e8-88e9-f11edd45193f service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:31.454627 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-7870a436-4cb3-42d9-83a9-2ddb5cf445fa req-3aaa2d95-225b-45e8-88e9-f11edd45193f service nova] Creating event network-vif-unplugged:8410643e-d59e-415c-b889-359fc6fba852 for instance 7c5acc09-82a3-4cb4-9c04-f582cf629c63 on hv-cinder-84460 Jun 21 18:46:31.462799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-7870a436-4cb3-42d9-83a9-2ddb5cf445fa req-3aaa2d95-225b-45e8-88e9-f11edd45193f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127963 Jun 21 18:46:31.463415 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 556/1110] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:46:31.924596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-5f700760-c2e1-463a-97f7-1e5266f95ee2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:31.925237 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-5f700760-c2e1-463a-97f7-1e5266f95ee2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:31.933261 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5f700760-c2e1-463a-97f7-1e5266f95ee2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:31.933749 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5f700760-c2e1-463a-97f7-1e5266f95ee2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:31.934600 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5f700760-c2e1-463a-97f7-1e5266f95ee2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:31.935041 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-5f700760-c2e1-463a-97f7-1e5266f95ee2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:32.108397 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-5f700760-c2e1-463a-97f7-1e5266f95ee2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:32.118022 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-5f700760-c2e1-463a-97f7-1e5266f95ee2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1575 microversion: 2.1 time: 0.197136 Jun 21 18:46:32.126713 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 555/1111] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:31 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1575 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:33.137961 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-9da9ecfd-1d5f-450a-9fd5-4555d41fc8d0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:33.138566 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-9da9ecfd-1d5f-450a-9fd5-4555d41fc8d0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:33.145424 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9da9ecfd-1d5f-450a-9fd5-4555d41fc8d0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:33.145888 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9da9ecfd-1d5f-450a-9fd5-4555d41fc8d0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:33.146686 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9da9ecfd-1d5f-450a-9fd5-4555d41fc8d0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:33.147118 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-9da9ecfd-1d5f-450a-9fd5-4555d41fc8d0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:33.294638 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-9da9ecfd-1d5f-450a-9fd5-4555d41fc8d0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:33.303514 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-9da9ecfd-1d5f-450a-9fd5-4555d41fc8d0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1575 microversion: 2.1 time: 0.170546 Jun 21 18:46:33.304157 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 557/1112] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:33 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:34.321135 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-66f14bee-c7fd-4fa6-bbf8-4cf7659833cb tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:34.321832 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-66f14bee-c7fd-4fa6-bbf8-4cf7659833cb tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:34.329529 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-66f14bee-c7fd-4fa6-bbf8-4cf7659833cb tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:34.330017 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-66f14bee-c7fd-4fa6-bbf8-4cf7659833cb tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:34.330841 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-66f14bee-c7fd-4fa6-bbf8-4cf7659833cb tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:34.331284 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-66f14bee-c7fd-4fa6-bbf8-4cf7659833cb tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:34.484166 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-66f14bee-c7fd-4fa6-bbf8-4cf7659833cb tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:34.498240 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-66f14bee-c7fd-4fa6-bbf8-4cf7659833cb tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1575 microversion: 2.1 time: 0.180854 Jun 21 18:46:34.499204 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 556/1113] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:34 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:35.522593 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-7ad1c98f-8ee2-42c0-8235-27df10b140d1 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:35.523552 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-7ad1c98f-8ee2-42c0-8235-27df10b140d1 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:35.530505 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7ad1c98f-8ee2-42c0-8235-27df10b140d1 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:35.530966 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7ad1c98f-8ee2-42c0-8235-27df10b140d1 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:35.531758 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7ad1c98f-8ee2-42c0-8235-27df10b140d1 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:35.532200 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7ad1c98f-8ee2-42c0-8235-27df10b140d1 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:35.718145 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-7ad1c98f-8ee2-42c0-8235-27df10b140d1 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:35.726849 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-7ad1c98f-8ee2-42c0-8235-27df10b140d1 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1575 microversion: 2.1 time: 0.208224 Jun 21 18:46:35.727438 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 558/1114] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:35 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1575 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:36.744748 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-df06e28a-e686-481b-b0eb-05e00269fcc2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:36.745492 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-df06e28a-e686-481b-b0eb-05e00269fcc2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:36.752719 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-df06e28a-e686-481b-b0eb-05e00269fcc2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:36.753168 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-df06e28a-e686-481b-b0eb-05e00269fcc2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:36.753989 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-df06e28a-e686-481b-b0eb-05e00269fcc2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:36.754469 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-df06e28a-e686-481b-b0eb-05e00269fcc2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:36.909266 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-df06e28a-e686-481b-b0eb-05e00269fcc2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:36.919282 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-df06e28a-e686-481b-b0eb-05e00269fcc2 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1575 microversion: 2.1 time: 0.178524 Jun 21 18:46:36.919872 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 557/1115] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:36 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:37.947295 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ec416882-7687-4d35-ab00-b2b75532e15c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:37.947939 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ec416882-7687-4d35-ab00-b2b75532e15c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:37.955242 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ec416882-7687-4d35-ab00-b2b75532e15c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:37.955690 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ec416882-7687-4d35-ab00-b2b75532e15c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:37.956493 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ec416882-7687-4d35-ab00-b2b75532e15c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:37.956923 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ec416882-7687-4d35-ab00-b2b75532e15c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:38.163244 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ec416882-7687-4d35-ab00-b2b75532e15c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:38.172538 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ec416882-7687-4d35-ab00-b2b75532e15c tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1575 microversion: 2.1 time: 0.229369 Jun 21 18:46:38.173123 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 559/1116] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:37 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1575 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:39.189981 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d4e009bb-3d90-4d9e-99a4-07b760b2e3de tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:39.190632 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-d4e009bb-3d90-4d9e-99a4-07b760b2e3de tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:39.198550 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d4e009bb-3d90-4d9e-99a4-07b760b2e3de tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:39.198997 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d4e009bb-3d90-4d9e-99a4-07b760b2e3de tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:39.199785 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d4e009bb-3d90-4d9e-99a4-07b760b2e3de tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:39.200216 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d4e009bb-3d90-4d9e-99a4-07b760b2e3de tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:39.394408 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-d4e009bb-3d90-4d9e-99a4-07b760b2e3de tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:39.404238 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-d4e009bb-3d90-4d9e-99a4-07b760b2e3de tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1575 microversion: 2.1 time: 0.218316 Jun 21 18:46:39.404997 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 558/1117] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:39 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1575 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:40.424851 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-67311b2b-3b34-4ed4-a605-820b8b295f25 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:40.425468 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-67311b2b-3b34-4ed4-a605-820b8b295f25 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:40.432891 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-67311b2b-3b34-4ed4-a605-820b8b295f25 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:40.433337 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-67311b2b-3b34-4ed4-a605-820b8b295f25 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:40.434146 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-67311b2b-3b34-4ed4-a605-820b8b295f25 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:40.434580 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-67311b2b-3b34-4ed4-a605-820b8b295f25 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:40.587830 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-67311b2b-3b34-4ed4-a605-820b8b295f25 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:40.595992 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-67311b2b-3b34-4ed4-a605-820b8b295f25 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1575 microversion: 2.1 time: 0.175076 Jun 21 18:46:40.596586 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 560/1118] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:40 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:41.614831 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b018bacb-f8fb-4c31-bd57-239f114d2218 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:41.615581 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b018bacb-f8fb-4c31-bd57-239f114d2218 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:41.623389 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b018bacb-f8fb-4c31-bd57-239f114d2218 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:41.623864 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b018bacb-f8fb-4c31-bd57-239f114d2218 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:41.624640 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b018bacb-f8fb-4c31-bd57-239f114d2218 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:41.625073 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b018bacb-f8fb-4c31-bd57-239f114d2218 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:41.792218 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-b018bacb-f8fb-4c31-bd57-239f114d2218 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:41.805453 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b018bacb-f8fb-4c31-bd57-239f114d2218 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1575 microversion: 2.1 time: 0.194883 Jun 21 18:46:41.806570 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 559/1119] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:41 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:41.958279 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c2d32974-a98c-4893-8fb7-e1260fab4d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:41.960006 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c2d32974-a98c-4893-8fb7-e1260fab4d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:41.971094 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c2d32974-a98c-4893-8fb7-e1260fab4d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:41.971737 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c2d32974-a98c-4893-8fb7-e1260fab4d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:41.972964 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c2d32974-a98c-4893-8fb7-e1260fab4d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:41.974255 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c2d32974-a98c-4893-8fb7-e1260fab4d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:42.018311 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c2d32974-a98c-4893-8fb7-e1260fab4d41 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.067263 Jun 21 18:46:42.019220 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 561/1120] 10.222.0.87 () {60 vars in 1342 bytes} [Tue Jun 21 18:46:41 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:42.096367 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-1b0c1d88-5d06-4710-b349-ff777bd6a8a6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:42.096866 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-1b0c1d88-5d06-4710-b349-ff777bd6a8a6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:42.103626 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1b0c1d88-5d06-4710-b349-ff777bd6a8a6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:42.104081 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1b0c1d88-5d06-4710-b349-ff777bd6a8a6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:42.104835 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1b0c1d88-5d06-4710-b349-ff777bd6a8a6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:42.105264 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1b0c1d88-5d06-4710-b349-ff777bd6a8a6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:42.135715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-1b0c1d88-5d06-4710-b349-ff777bd6a8a6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Going to try to terminate instance {{(pid=118108) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:46:42.233484 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-1b0c1d88-5d06-4710-b349-ff777bd6a8a6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "DELETE /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 204 len: 0 microversion: 2.20 time: 0.140703 Jun 21 18:46:42.234615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 560/1121] 10.222.0.87 () {60 vars in 1279 bytes} [Tue Jun 21 18:46:42 2022] DELETE /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 18:46:42.246378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e1edf80d-db56-44f2-b2dd-6e50172721f6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:42.247117 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e1edf80d-db56-44f2-b2dd-6e50172721f6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:42.256462 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e1edf80d-db56-44f2-b2dd-6e50172721f6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:42.257264 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e1edf80d-db56-44f2-b2dd-6e50172721f6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:42.259410 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e1edf80d-db56-44f2-b2dd-6e50172721f6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:42.259618 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e1edf80d-db56-44f2-b2dd-6e50172721f6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:42.421293 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e1edf80d-db56-44f2-b2dd-6e50172721f6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:42.430820 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e1edf80d-db56-44f2-b2dd-6e50172721f6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:42.432482 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e1edf80d-db56-44f2-b2dd-6e50172721f6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:42.433739 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e1edf80d-db56-44f2-b2dd-6e50172721f6 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1722 microversion: 2.20 time: 0.192186 Jun 21 18:46:42.434378 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 562/1122] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:46:42 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:46:42.831745 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-50b7f938-133c-4ca6-b8fc-3e53245e3638 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:42.833242 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-50b7f938-133c-4ca6-b8fc-3e53245e3638 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:42.840849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-50b7f938-133c-4ca6-b8fc-3e53245e3638 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:42.841323 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-50b7f938-133c-4ca6-b8fc-3e53245e3638 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:42.842125 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-50b7f938-133c-4ca6-b8fc-3e53245e3638 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:42.842560 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-50b7f938-133c-4ca6-b8fc-3e53245e3638 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:43.001417 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-50b7f938-133c-4ca6-b8fc-3e53245e3638 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:43.010446 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-50b7f938-133c-4ca6-b8fc-3e53245e3638 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1575 microversion: 2.1 time: 0.183076 Jun 21 18:46:43.011022 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 561/1123] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:42 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1575 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:43.398563 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-923bf73f-3e40-4948-9d6c-8dbf3eaa57d2 req-326a710f-0038-40d7-a7f4-55e6eb3a1edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c5acc09-82a3-4cb4-9c04-f582cf629c63", "name": "network-vif-plugged", "status": "completed", "tag": "8410643e-d59e-415c-b889-359fc6fba852"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:46:43.415429 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-923bf73f-3e40-4948-9d6c-8dbf3eaa57d2 req-326a710f-0038-40d7-a7f4-55e6eb3a1edf service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:43.416192 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-923bf73f-3e40-4948-9d6c-8dbf3eaa57d2 req-326a710f-0038-40d7-a7f4-55e6eb3a1edf service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:43.437462 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-923bf73f-3e40-4948-9d6c-8dbf3eaa57d2 req-326a710f-0038-40d7-a7f4-55e6eb3a1edf service nova] Creating event network-vif-plugged:8410643e-d59e-415c-b889-359fc6fba852 for instance 7c5acc09-82a3-4cb4-9c04-f582cf629c63 on hv-cinder-84460 Jun 21 18:46:43.446955 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-923bf73f-3e40-4948-9d6c-8dbf3eaa57d2 req-326a710f-0038-40d7-a7f4-55e6eb3a1edf service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054964 Jun 21 18:46:43.448035 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 563/1124] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:46:43.459155 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-f1a8d86d-49bb-42f4-9d52-e82a417c6b38 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:43.460421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-f1a8d86d-49bb-42f4-9d52-e82a417c6b38 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:43.472851 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f1a8d86d-49bb-42f4-9d52-e82a417c6b38 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:43.474653 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f1a8d86d-49bb-42f4-9d52-e82a417c6b38 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:43.476204 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f1a8d86d-49bb-42f4-9d52-e82a417c6b38 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:43.476973 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-f1a8d86d-49bb-42f4-9d52-e82a417c6b38 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:43.691830 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f1a8d86d-49bb-42f4-9d52-e82a417c6b38 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:43.703244 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f1a8d86d-49bb-42f4-9d52-e82a417c6b38 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:43.704769 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-f1a8d86d-49bb-42f4-9d52-e82a417c6b38 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:43.705983 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-f1a8d86d-49bb-42f4-9d52-e82a417c6b38 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1722 microversion: 2.20 time: 0.255754 Jun 21 18:46:43.706540 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 562/1125] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:46:43 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:46:44.033909 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-1d422bab-d280-4e2c-acdf-0af548e62a44 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:44.034619 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-1d422bab-d280-4e2c-acdf-0af548e62a44 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:44.042096 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1d422bab-d280-4e2c-acdf-0af548e62a44 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:44.042545 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1d422bab-d280-4e2c-acdf-0af548e62a44 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:44.043342 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1d422bab-d280-4e2c-acdf-0af548e62a44 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:44.043780 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-1d422bab-d280-4e2c-acdf-0af548e62a44 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:44.248563 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-1d422bab-d280-4e2c-acdf-0af548e62a44 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:44.257091 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-1d422bab-d280-4e2c-acdf-0af548e62a44 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1575 microversion: 2.1 time: 0.227590 Jun 21 18:46:44.257700 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 564/1126] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:44 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:44.729596 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a40c4ed6-768c-49e9-9479-45397b5aaa05 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:44.730429 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-a40c4ed6-768c-49e9-9479-45397b5aaa05 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:44.738358 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a40c4ed6-768c-49e9-9479-45397b5aaa05 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:44.738852 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a40c4ed6-768c-49e9-9479-45397b5aaa05 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:44.739908 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a40c4ed6-768c-49e9-9479-45397b5aaa05 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:44.740398 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a40c4ed6-768c-49e9-9479-45397b5aaa05 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:44.998506 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-a40c4ed6-768c-49e9-9479-45397b5aaa05 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:45.008800 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-a40c4ed6-768c-49e9-9479-45397b5aaa05 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:45.011317 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-a40c4ed6-768c-49e9-9479-45397b5aaa05 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:45.013186 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a40c4ed6-768c-49e9-9479-45397b5aaa05 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1722 microversion: 2.20 time: 0.288909 Jun 21 18:46:45.013990 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 563/1127] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:46:44 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:46:45.278392 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-410b6823-ebd3-4091-9730-21b6dd9eb7fd tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:45.279240 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-410b6823-ebd3-4091-9730-21b6dd9eb7fd tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:45.287206 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-410b6823-ebd3-4091-9730-21b6dd9eb7fd tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:45.287844 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-410b6823-ebd3-4091-9730-21b6dd9eb7fd tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:45.289298 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-410b6823-ebd3-4091-9730-21b6dd9eb7fd tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:45.289503 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-410b6823-ebd3-4091-9730-21b6dd9eb7fd tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:45.599517 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-410b6823-ebd3-4091-9730-21b6dd9eb7fd tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:45.615453 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-410b6823-ebd3-4091-9730-21b6dd9eb7fd tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1575 microversion: 2.1 time: 0.341447 Jun 21 18:46:45.619772 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 565/1128] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:45 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1575 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:45.689181 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-c2631745-318e-4883-9b81-552442682652 req-00a37b3d-7119-47bf-a8ee-8c66f430541b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba08486-1cfb-443b-9e39-ba65962dd01e", "name": "network-vif-deleted", "tag": "bffcf1ea-ece3-4130-9438-75fbde5fa0bf"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:46:45.698589 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-c2631745-318e-4883-9b81-552442682652 req-00a37b3d-7119-47bf-a8ee-8c66f430541b service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:45.699028 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-c2631745-318e-4883-9b81-552442682652 req-00a37b3d-7119-47bf-a8ee-8c66f430541b service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:45.703458 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:46:45.722790 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-c2631745-318e-4883-9b81-552442682652 req-00a37b3d-7119-47bf-a8ee-8c66f430541b service nova] Creating event network-vif-deleted:bffcf1ea-ece3-4130-9438-75fbde5fa0bf for instance 2ba08486-1cfb-443b-9e39-ba65962dd01e on hv-cinder-84460 Jun 21 18:46:45.735131 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-c2631745-318e-4883-9b81-552442682652 req-00a37b3d-7119-47bf-a8ee-8c66f430541b service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124849 Jun 21 18:46:45.736158 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 564/1129] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:46:46.032793 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-bcc6bff9-e76f-4f8c-ab9d-8cc7f49146d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:46.033409 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-bcc6bff9-e76f-4f8c-ab9d-8cc7f49146d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:46.041136 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bcc6bff9-e76f-4f8c-ab9d-8cc7f49146d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:46.041959 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bcc6bff9-e76f-4f8c-ab9d-8cc7f49146d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:46.042823 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bcc6bff9-e76f-4f8c-ab9d-8cc7f49146d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:46.043251 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-bcc6bff9-e76f-4f8c-ab9d-8cc7f49146d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:46.127884 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-bcc6bff9-e76f-4f8c-ab9d-8cc7f49146d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:46.138785 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-bcc6bff9-e76f-4f8c-ab9d-8cc7f49146d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:46.140917 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-bcc6bff9-e76f-4f8c-ab9d-8cc7f49146d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93785710c10749f9aa3d29b43965909c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a4c114c12d40abb896e2637ee6ab83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:46.142492 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-bcc6bff9-e76f-4f8c-ab9d-8cc7f49146d1 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 200 len: 1366 microversion: 2.20 time: 0.113816 Jun 21 18:46:46.143070 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 566/1130] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:46:46 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 1366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 18:46:46.642331 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-17333806-bc6a-4e43-b929-58896f58e54d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:46.643725 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-17333806-bc6a-4e43-b929-58896f58e54d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:46.658091 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-17333806-bc6a-4e43-b929-58896f58e54d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:46.658990 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-17333806-bc6a-4e43-b929-58896f58e54d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:46.660464 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-17333806-bc6a-4e43-b929-58896f58e54d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:46.662302 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-17333806-bc6a-4e43-b929-58896f58e54d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:46.862253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-17333806-bc6a-4e43-b929-58896f58e54d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:46:46.875131 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-17333806-bc6a-4e43-b929-58896f58e54d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1562 microversion: 2.1 time: 0.239781 Jun 21 18:46:46.876189 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 565/1131] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:46:46 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1562 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:46:47.169100 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c8fff027-1ed2-4f9e-8029-ccb823500162 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:47.169856 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c8fff027-1ed2-4f9e-8029-ccb823500162 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:47.178116 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c8fff027-1ed2-4f9e-8029-ccb823500162 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:47.178561 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c8fff027-1ed2-4f9e-8029-ccb823500162 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:47.179363 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c8fff027-1ed2-4f9e-8029-ccb823500162 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:47.179787 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c8fff027-1ed2-4f9e-8029-ccb823500162 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:47.198542 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-c8fff027-1ed2-4f9e-8029-ccb823500162 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] HTTP exception thrown: Instance 2ba08486-1cfb-443b-9e39-ba65962dd01e could not be found. Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c8fff027-1ed2-4f9e-8029-ccb823500162 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Request method failure captured: Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e HTTP/1.1 Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABishARPnL_sqkJOwUwUdv-Kudej4fgBpNABEa3Xl8XXMR1YhBYstjm5v48DSgQXDvnu2OeMVyoWO0unkvh7GXepLvqWbp9OArS_Hi2NaxjZ5ZE-up7t9q0f5SFZk63sTZvjuwrCcY0elI9T7XxojEIr2uviMaB3trJFEziaWf_bkY9L1M Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 21a4c114c12d40abb896e2637ee6ab83 Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1134987768 Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:46:47.200496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:46:47.203187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:46:47.203187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1134987768 Jun 21 18:46:47.203187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 21a4c114c12d40abb896e2637ee6ab83 Jun 21 18:46:47.203187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1134987768 Jun 21 18:46:47.203187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-AttachVolumeShelveTestJSON-1134987768-project Jun 21 18:46:47.203187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:46:47.203187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:46:47.203187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: 93785710c10749f9aa3d29b43965909c Jun 21 18:46:47.203187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1134987768-project Jun 21 18:46:47.203187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:46:47.203187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance 2ba08486-1cfb-443b-9e39-ba65962dd01e could not be found. Jun 21 18:46:47.203187 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': '2ba08486-1cfb-443b-9e39-ba65962dd01e'} Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ba08486-1cfb-443b-9e39-ba65962dd01e could not be found. Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:46:47.204831 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:46:47.208180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:46:47.208180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:46:47.208180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:46:47.208180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:46:47.208180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:46:47.208180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:46:47.208180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:46:47.208180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ba08486-1cfb-443b-9e39-ba65962dd01e could not be found. Jun 21 18:46:47.208180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:46:47.208180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:46:47.208180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:46:47.208180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:46:47.208180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:46:47.208180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:46:47.208180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:46:47.208180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:46:47.208180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ba08486-1cfb-443b-9e39-ba65962dd01e could not be found. Jun 21 18:46:47.208180 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:46:47.211327 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c8fff027-1ed2-4f9e-8029-ccb823500162 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Returning 404 to user: Instance 2ba08486-1cfb-443b-9e39-ba65962dd01e could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:46:47.211327 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c8fff027-1ed2-4f9e-8029-ccb823500162 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 404 len: 111 microversion: 2.20 time: 0.037426 Jun 21 18:46:47.211327 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 567/1132] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:46:47 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 18:46:47.215402 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-02661cb8-4d2c-4bf0-b152-ed0461330432 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '.version_select at 0x7fd8b2f665e0>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:47.241629 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-02661cb8-4d2c-4bf0-b152-ed0461330432 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-550487554" status: 204 len: 0 microversion: 2.20 time: 0.030615 Jun 21 18:46:47.242481 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 566/1133] 10.222.0.87 () {60 vars in 1258 bytes} [Tue Jun 21 18:46:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-550487554 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 18:46:49.426847 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8164da9b-273c-4856-8f55-b47d53a301c8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:49.427940 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8164da9b-273c-4856-8f55-b47d53a301c8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:49.435041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8164da9b-273c-4856-8f55-b47d53a301c8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:49.435474 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8164da9b-273c-4856-8f55-b47d53a301c8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:49.436278 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8164da9b-273c-4856-8f55-b47d53a301c8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:49.436713 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8164da9b-273c-4856-8f55-b47d53a301c8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:49.452870 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-8164da9b-273c-4856-8f55-b47d53a301c8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] HTTP exception thrown: Instance 2ba08486-1cfb-443b-9e39-ba65962dd01e could not be found. Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8164da9b-273c-4856-8f55-b47d53a301c8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Request method failure captured: Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: DELETE /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e HTTP/1.1 Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABishARPnL_sqkJOwUwUdv-Kudej4fgBpNABEa3Xl8XXMR1YhBYstjm5v48DSgQXDvnu2OeMVyoWO0unkvh7GXepLvqWbp9OArS_Hi2NaxjZ5ZE-up7t9q0f5SFZk63sTZvjuwrCcY0elI9T7XxojEIr2uviMaB3trJFEziaWf_bkY9L1M Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 21a4c114c12d40abb896e2637ee6ab83 Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1134987768 Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:46:49.454496 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:46:49.458086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:46:49.458086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1134987768 Jun 21 18:46:49.458086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 21a4c114c12d40abb896e2637ee6ab83 Jun 21 18:46:49.458086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1134987768 Jun 21 18:46:49.458086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-AttachVolumeShelveTestJSON-1134987768-project Jun 21 18:46:49.458086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:46:49.458086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:46:49.458086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: 93785710c10749f9aa3d29b43965909c Jun 21 18:46:49.458086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1134987768-project Jun 21 18:46:49.458086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:46:49.458086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance 2ba08486-1cfb-443b-9e39-ba65962dd01e could not be found. Jun 21 18:46:49.458086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': '2ba08486-1cfb-443b-9e39-ba65962dd01e'} Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ba08486-1cfb-443b-9e39-ba65962dd01e could not be found. Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:46:49.459743 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ba08486-1cfb-443b-9e39-ba65962dd01e could not be found. Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ba08486-1cfb-443b-9e39-ba65962dd01e could not be found. Jun 21 18:46:49.462620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:46:49.465945 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8164da9b-273c-4856-8f55-b47d53a301c8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Returning 404 to user: Instance 2ba08486-1cfb-443b-9e39-ba65962dd01e could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:46:49.465945 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8164da9b-273c-4856-8f55-b47d53a301c8 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "DELETE /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 404 len: 111 microversion: 2.20 time: 0.033656 Jun 21 18:46:49.465945 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 568/1134] 10.222.0.87 () {60 vars in 1279 bytes} [Tue Jun 21 18:46:49 2022] DELETE /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 18:46:49.468311 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-92b8bfd0-62ff-44dc-85ac-ba47c4d7d865 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:49.469088 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-92b8bfd0-62ff-44dc-85ac-ba47c4d7d865 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 2ba08486-1cfb-443b-9e39-ba65962dd01e] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:49.476761 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-92b8bfd0-62ff-44dc-85ac-ba47c4d7d865 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:49.477116 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-92b8bfd0-62ff-44dc-85ac-ba47c4d7d865 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:49.478104 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-92b8bfd0-62ff-44dc-85ac-ba47c4d7d865 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:49.478552 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-92b8bfd0-62ff-44dc-85ac-ba47c4d7d865 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:49.494589 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-92b8bfd0-62ff-44dc-85ac-ba47c4d7d865 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] HTTP exception thrown: Instance 2ba08486-1cfb-443b-9e39-ba65962dd01e could not be found. Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-92b8bfd0-62ff-44dc-85ac-ba47c4d7d865 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Request method failure captured: Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e HTTP/1.1 Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABishARPnL_sqkJOwUwUdv-Kudej4fgBpNABEa3Xl8XXMR1YhBYstjm5v48DSgQXDvnu2OeMVyoWO0unkvh7GXepLvqWbp9OArS_Hi2NaxjZ5ZE-up7t9q0f5SFZk63sTZvjuwrCcY0elI9T7XxojEIr2uviMaB3trJFEziaWf_bkY9L1M Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 21a4c114c12d40abb896e2637ee6ab83 Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1134987768 Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:46:49.496318 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:46:49.499183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:46:49.499183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1134987768 Jun 21 18:46:49.499183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 21a4c114c12d40abb896e2637ee6ab83 Jun 21 18:46:49.499183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1134987768 Jun 21 18:46:49.499183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-AttachVolumeShelveTestJSON-1134987768-project Jun 21 18:46:49.499183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:46:49.499183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:46:49.499183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 93785710c10749f9aa3d29b43965909c Jun 21 18:46:49.499183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1134987768-project Jun 21 18:46:49.499183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:46:49.499183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance 2ba08486-1cfb-443b-9e39-ba65962dd01e could not be found. Jun 21 18:46:49.499183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': '2ba08486-1cfb-443b-9e39-ba65962dd01e'} Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ba08486-1cfb-443b-9e39-ba65962dd01e could not be found. Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:46:49.500715 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:46:49.503197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:46:49.503197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:46:49.503197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:46:49.503197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:46:49.503197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:46:49.503197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:46:49.503197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:46:49.503197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ba08486-1cfb-443b-9e39-ba65962dd01e could not be found. Jun 21 18:46:49.503197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:46:49.503197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:46:49.503197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:46:49.503197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:46:49.503197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:46:49.503197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:46:49.503197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:46:49.503197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:46:49.503197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ba08486-1cfb-443b-9e39-ba65962dd01e could not be found. Jun 21 18:46:49.503197 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:46:49.505477 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-92b8bfd0-62ff-44dc-85ac-ba47c4d7d865 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Returning 404 to user: Instance 2ba08486-1cfb-443b-9e39-ba65962dd01e could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:46:49.505477 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-92b8bfd0-62ff-44dc-85ac-ba47c4d7d865 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e" status: 404 len: 111 microversion: 2.20 time: 0.035733 Jun 21 18:46:49.505477 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 567/1135] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:46:49 2022] GET /compute/v2.1/servers/2ba08486-1cfb-443b-9e39-ba65962dd01e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 18:46:50.654148 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ffb89f23-1062-4c7f-909c-3bc1f2072db7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:50.655059 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ffb89f23-1062-4c7f-909c-3bc1f2072db7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:50.662122 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ffb89f23-1062-4c7f-909c-3bc1f2072db7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:50.662568 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ffb89f23-1062-4c7f-909c-3bc1f2072db7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:50.663365 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ffb89f23-1062-4c7f-909c-3bc1f2072db7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:50.663799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ffb89f23-1062-4c7f-909c-3bc1f2072db7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:50.679046 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-ffb89f23-1062-4c7f-909c-3bc1f2072db7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] HTTP exception thrown: Instance 4aab1542-b7fd-4057-9da2-8bcef1265883 could not be found. Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ffb89f23-1062-4c7f-909c-3bc1f2072db7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Request method failure captured: Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: DELETE /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 HTTP/1.1 Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABishARPnL_sqkJOwUwUdv-Kudej4fgBpNABEa3Xl8XXMR1YhBYstjm5v48DSgQXDvnu2OeMVyoWO0unkvh7GXepLvqWbp9OArS_Hi2NaxjZ5ZE-up7t9q0f5SFZk63sTZvjuwrCcY0elI9T7XxojEIr2uviMaB3trJFEziaWf_bkY9L1M Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 21a4c114c12d40abb896e2637ee6ab83 Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1134987768 Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:46:50.680666 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:46:50.683406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:46:50.683406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1134987768 Jun 21 18:46:50.683406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 21a4c114c12d40abb896e2637ee6ab83 Jun 21 18:46:50.683406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1134987768 Jun 21 18:46:50.683406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-AttachVolumeShelveTestJSON-1134987768-project Jun 21 18:46:50.683406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:46:50.683406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:46:50.683406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: 93785710c10749f9aa3d29b43965909c Jun 21 18:46:50.683406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1134987768-project Jun 21 18:46:50.683406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:46:50.683406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance 4aab1542-b7fd-4057-9da2-8bcef1265883 could not be found. Jun 21 18:46:50.683406 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': '4aab1542-b7fd-4057-9da2-8bcef1265883'} Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aab1542-b7fd-4057-9da2-8bcef1265883 could not be found. Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:46:50.685164 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aab1542-b7fd-4057-9da2-8bcef1265883 could not be found. Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aab1542-b7fd-4057-9da2-8bcef1265883 could not be found. Jun 21 18:46:50.688089 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:46:50.690456 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ffb89f23-1062-4c7f-909c-3bc1f2072db7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Returning 404 to user: Instance 4aab1542-b7fd-4057-9da2-8bcef1265883 could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:46:50.690456 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ffb89f23-1062-4c7f-909c-3bc1f2072db7 tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "DELETE /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 404 len: 111 microversion: 2.20 time: 0.032398 Jun 21 18:46:50.690456 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 569/1136] 10.222.0.87 () {60 vars in 1279 bytes} [Tue Jun 21 18:46:50 2022] DELETE /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 21 18:46:50.695421 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a2302885-c47a-4ab1-a797-c61b50c88c7a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:46:50.696539 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-a2302885-c47a-4ab1-a797-c61b50c88c7a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] [instance: 4aab1542-b7fd-4057-9da2-8bcef1265883] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:46:50.709099 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a2302885-c47a-4ab1-a797-c61b50c88c7a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:50.709885 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a2302885-c47a-4ab1-a797-c61b50c88c7a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:50.711198 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a2302885-c47a-4ab1-a797-c61b50c88c7a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:46:50.712729 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-a2302885-c47a-4ab1-a797-c61b50c88c7a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:46:50.738448 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-a2302885-c47a-4ab1-a797-c61b50c88c7a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] HTTP exception thrown: Instance 4aab1542-b7fd-4057-9da2-8bcef1265883 could not be found. Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a2302885-c47a-4ab1-a797-c61b50c88c7a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Request method failure captured: Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 HTTP/1.1 Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABishARPnL_sqkJOwUwUdv-Kudej4fgBpNABEa3Xl8XXMR1YhBYstjm5v48DSgQXDvnu2OeMVyoWO0unkvh7GXepLvqWbp9OArS_Hi2NaxjZ5ZE-up7t9q0f5SFZk63sTZvjuwrCcY0elI9T7XxojEIr2uviMaB3trJFEziaWf_bkY9L1M Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 21a4c114c12d40abb896e2637ee6ab83 Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1134987768 Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:46:50.741717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:46:50.744460 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_21a4c114c12d40abb896e2637ee6ab83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:46:50.744460 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1134987768 Jun 21 18:46:50.744460 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 21a4c114c12d40abb896e2637ee6ab83 Jun 21 18:46:50.744460 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1134987768 Jun 21 18:46:50.744460 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-AttachVolumeShelveTestJSON-1134987768-project Jun 21 18:46:50.744460 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:46:50.744460 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:46:50.744460 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 93785710c10749f9aa3d29b43965909c Jun 21 18:46:50.744460 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1134987768-project Jun 21 18:46:50.744460 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:46:50.744460 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance 4aab1542-b7fd-4057-9da2-8bcef1265883 could not be found. Jun 21 18:46:50.744460 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': '4aab1542-b7fd-4057-9da2-8bcef1265883'} Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aab1542-b7fd-4057-9da2-8bcef1265883 could not be found. Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:46:50.745938 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:46:50.747850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:46:50.747850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:46:50.747850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:46:50.747850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:46:50.747850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:46:50.747850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:46:50.747850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:46:50.747850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aab1542-b7fd-4057-9da2-8bcef1265883 could not be found. Jun 21 18:46:50.747850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:46:50.747850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:46:50.747850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:46:50.747850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:46:50.747850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:46:50.747850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:46:50.747850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:46:50.747850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:46:50.747850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aab1542-b7fd-4057-9da2-8bcef1265883 could not be found. Jun 21 18:46:50.747850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:46:50.750360 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-a2302885-c47a-4ab1-a797-c61b50c88c7a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] Returning 404 to user: Instance 4aab1542-b7fd-4057-9da2-8bcef1265883 could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:46:50.750360 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-a2302885-c47a-4ab1-a797-c61b50c88c7a tempest-AttachVolumeShelveTestJSON-1134987768 tempest-AttachVolumeShelveTestJSON-1134987768-project] 10.222.0.87 "GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883" status: 404 len: 111 microversion: 2.20 time: 0.055234 Jun 21 18:46:50.750360 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 568/1137] 10.222.0.87 () {60 vars in 1276 bytes} [Tue Jun 21 18:46:50 2022] GET /compute/v2.1/servers/4aab1542-b7fd-4057-9da2-8bcef1265883 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 18:48:27.806732 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=31 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:48:27.808041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=86 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:48:27.813952 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-018675ab-c395-4e31-87a5-b02e2830cfe5 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:27.814853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-018675ab-c395-4e31-87a5-b02e2830cfe5 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:27.822713 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-018675ab-c395-4e31-87a5-b02e2830cfe5 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:27.823213 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-018675ab-c395-4e31-87a5-b02e2830cfe5 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:27.824247 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-018675ab-c395-4e31-87a5-b02e2830cfe5 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:27.825446 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-018675ab-c395-4e31-87a5-b02e2830cfe5 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:27.828460 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:48:27.830637 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=10 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:48:27.866899 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-018675ab-c395-4e31-87a5-b02e2830cfe5 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Going to try to terminate instance {{(pid=118109) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:48:28.020534 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-018675ab-c395-4e31-87a5-b02e2830cfe5 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "DELETE /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 204 len: 0 microversion: 2.1 time: 0.215361 Jun 21 18:48:28.021871 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 570/1138] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:48:27 2022] DELETE /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 18:48:28.030237 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a688d4d5-bd0e-4101-9bc5-17b69356b041 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:28.030621 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-ac198c3f-9349-48e4-8202-602ec7fb414e req-5096fc99-8c97-493f-938e-4419af7d4275 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c5acc09-82a3-4cb4-9c04-f582cf629c63", "tag": "8410643e-d59e-415c-b889-359fc6fba852"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:48:28.030950 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-a688d4d5-bd0e-4101-9bc5-17b69356b041 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:28.037993 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a688d4d5-bd0e-4101-9bc5-17b69356b041 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:28.038494 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a688d4d5-bd0e-4101-9bc5-17b69356b041 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:28.039726 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a688d4d5-bd0e-4101-9bc5-17b69356b041 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:28.040478 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a688d4d5-bd0e-4101-9bc5-17b69356b041 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:28.053902 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-ac198c3f-9349-48e4-8202-602ec7fb414e req-5096fc99-8c97-493f-938e-4419af7d4275 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:28.054311 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-ac198c3f-9349-48e4-8202-602ec7fb414e req-5096fc99-8c97-493f-938e-4419af7d4275 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:28.080605 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-ac198c3f-9349-48e4-8202-602ec7fb414e req-5096fc99-8c97-493f-938e-4419af7d4275 service nova] Creating event network-changed:8410643e-d59e-415c-b889-359fc6fba852 for instance 7c5acc09-82a3-4cb4-9c04-f582cf629c63 on hv-cinder-84460 Jun 21 18:48:28.090244 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-ac198c3f-9349-48e4-8202-602ec7fb414e req-5096fc99-8c97-493f-938e-4419af7d4275 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.270739 Jun 21 18:48:28.091193 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 569/1139] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:48:28.209050 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-a688d4d5-bd0e-4101-9bc5-17b69356b041 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:28.217157 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-a688d4d5-bd0e-4101-9bc5-17b69356b041 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1568 microversion: 2.1 time: 0.191478 Jun 21 18:48:28.217765 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 571/1140] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:28 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:48:29.238249 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-d5abec61-8688-4ad1-bb82-2d659a6f7a6d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:29.239064 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-d5abec61-8688-4ad1-bb82-2d659a6f7a6d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:29.246906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d5abec61-8688-4ad1-bb82-2d659a6f7a6d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:29.247346 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d5abec61-8688-4ad1-bb82-2d659a6f7a6d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:29.248178 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d5abec61-8688-4ad1-bb82-2d659a6f7a6d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:29.248646 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-d5abec61-8688-4ad1-bb82-2d659a6f7a6d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:29.395074 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-d5abec61-8688-4ad1-bb82-2d659a6f7a6d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:29.403585 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-d5abec61-8688-4ad1-bb82-2d659a6f7a6d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1568 microversion: 2.1 time: 0.171771 Jun 21 18:48:29.404140 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 570/1141] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:29 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:48:30.421853 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-cccbcb73-000b-43e5-aa09-f30413887fc0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:30.422719 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-cccbcb73-000b-43e5-aa09-f30413887fc0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:30.431871 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cccbcb73-000b-43e5-aa09-f30413887fc0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:30.432509 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cccbcb73-000b-43e5-aa09-f30413887fc0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:30.433839 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cccbcb73-000b-43e5-aa09-f30413887fc0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:30.434567 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-cccbcb73-000b-43e5-aa09-f30413887fc0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:30.663700 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-cccbcb73-000b-43e5-aa09-f30413887fc0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:30.677978 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-cccbcb73-000b-43e5-aa09-f30413887fc0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1568 microversion: 2.1 time: 0.259900 Jun 21 18:48:30.679323 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 572/1142] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:30 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1568 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:48:31.709855 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-7bb449ea-e1c4-4b86-a748-38e426b1529d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:31.710862 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-7bb449ea-e1c4-4b86-a748-38e426b1529d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:31.722819 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7bb449ea-e1c4-4b86-a748-38e426b1529d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:31.723607 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7bb449ea-e1c4-4b86-a748-38e426b1529d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:31.725003 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7bb449ea-e1c4-4b86-a748-38e426b1529d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:31.725844 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-7bb449ea-e1c4-4b86-a748-38e426b1529d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:31.792949 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-759a59a7-2524-499e-89e0-deece6eebfd9 req-2d00c31f-e82e-4924-906a-a4d2da07ccf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c5acc09-82a3-4cb4-9c04-f582cf629c63", "name": "network-vif-deleted", "tag": "8410643e-d59e-415c-b889-359fc6fba852"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:48:31.810750 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-759a59a7-2524-499e-89e0-deece6eebfd9 req-2d00c31f-e82e-4924-906a-a4d2da07ccf4 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:31.812574 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-759a59a7-2524-499e-89e0-deece6eebfd9 req-2d00c31f-e82e-4924-906a-a4d2da07ccf4 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:31.839898 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-7bb449ea-e1c4-4b86-a748-38e426b1529d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:31.853403 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-7bb449ea-e1c4-4b86-a748-38e426b1529d tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1381 microversion: 2.1 time: 0.151822 Jun 21 18:48:31.854752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 571/1143] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:31 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1381 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:48:31.872990 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-759a59a7-2524-499e-89e0-deece6eebfd9 req-2d00c31f-e82e-4924-906a-a4d2da07ccf4 service nova] Creating event network-vif-deleted:8410643e-d59e-415c-b889-359fc6fba852 for instance 7c5acc09-82a3-4cb4-9c04-f582cf629c63 on hv-cinder-84460 Jun 21 18:48:31.883364 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-759a59a7-2524-499e-89e0-deece6eebfd9 req-2d00c31f-e82e-4924-906a-a4d2da07ccf4 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099518 Jun 21 18:48:31.884694 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 573/1144] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:48:32.882584 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-b70c9acd-b261-4f56-a1f9-8d56c782162e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:32.883655 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-b70c9acd-b261-4f56-a1f9-8d56c782162e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:32.895376 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b70c9acd-b261-4f56-a1f9-8d56c782162e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:32.895850 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b70c9acd-b261-4f56-a1f9-8d56c782162e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:32.896660 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b70c9acd-b261-4f56-a1f9-8d56c782162e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:32.897327 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-b70c9acd-b261-4f56-a1f9-8d56c782162e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:32.976190 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-b70c9acd-b261-4f56-a1f9-8d56c782162e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:32.990282 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-b70c9acd-b261-4f56-a1f9-8d56c782162e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1219 microversion: 2.1 time: 0.114075 Jun 21 18:48:32.991334 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 572/1145] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:32 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:48:34.014380 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-30f28a14-cfff-4a15-b2c5-26e930aa786e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:34.015169 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-30f28a14-cfff-4a15-b2c5-26e930aa786e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:34.023235 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-30f28a14-cfff-4a15-b2c5-26e930aa786e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:34.023687 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-30f28a14-cfff-4a15-b2c5-26e930aa786e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:34.024706 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-30f28a14-cfff-4a15-b2c5-26e930aa786e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:34.025150 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-30f28a14-cfff-4a15-b2c5-26e930aa786e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:34.096625 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-30f28a14-cfff-4a15-b2c5-26e930aa786e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:34.105077 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-30f28a14-cfff-4a15-b2c5-26e930aa786e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1219 microversion: 2.1 time: 0.095850 Jun 21 18:48:34.105687 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 574/1146] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:34 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:48:35.123915 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-90f1d3b9-34c3-4dee-bf69-eea9a7baa39e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:35.124791 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-90f1d3b9-34c3-4dee-bf69-eea9a7baa39e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:35.134492 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-90f1d3b9-34c3-4dee-bf69-eea9a7baa39e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:35.135310 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-90f1d3b9-34c3-4dee-bf69-eea9a7baa39e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:35.136648 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-90f1d3b9-34c3-4dee-bf69-eea9a7baa39e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:35.137400 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-90f1d3b9-34c3-4dee-bf69-eea9a7baa39e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:35.218723 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-90f1d3b9-34c3-4dee-bf69-eea9a7baa39e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:35.227812 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-90f1d3b9-34c3-4dee-bf69-eea9a7baa39e tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1219 microversion: 2.1 time: 0.108122 Jun 21 18:48:35.228396 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 573/1147] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:35 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:48:36.246321 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b861423c-7a3d-43bc-af83-483eccc64079 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:36.247245 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b861423c-7a3d-43bc-af83-483eccc64079 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:36.254729 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b861423c-7a3d-43bc-af83-483eccc64079 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:36.255189 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b861423c-7a3d-43bc-af83-483eccc64079 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:36.257041 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b861423c-7a3d-43bc-af83-483eccc64079 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:36.257523 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b861423c-7a3d-43bc-af83-483eccc64079 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:36.312303 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b861423c-7a3d-43bc-af83-483eccc64079 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:36.312751 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-b861423c-7a3d-43bc-af83-483eccc64079 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:36.313939 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.objects.instance [None req-b861423c-7a3d-43bc-af83-483eccc64079 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lazy-loading 'fault' on Instance uuid 7c5acc09-82a3-4cb4-9c04-f582cf629c63 {{(pid=118109) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 18:48:36.373369 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-3a92e946-78f0-4e12-9bad-407f3b8b0c9c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2089313116", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-198007524", "security_groups": [{"name": "tempest-secgroup-smoke-179192695"}], "block_device_mapping_v2": [{"uuid": "d69c301e-ee62-42ca-ab6b-2facbe714c31", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a330634b-a2bf-4221-a2b7-6d2504bd49e4"}]}} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:48:36.382065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b861423c-7a3d-43bc-af83-483eccc64079 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea95ad1fabb74ba692aa9172128035eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990014bc19574d66ae5faae5c0751d5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:36.397414 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b861423c-7a3d-43bc-af83-483eccc64079 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 200 len: 1224 microversion: 2.1 time: 0.154626 Jun 21 18:48:36.397919 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 575/1148] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:36 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 1224 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:48:36.511635 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.network.neutron [None req-3a92e946-78f0-4e12-9bad-407f3b8b0c9c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] validate_networks() for [('a330634b-a2bf-4221-a2b7-6d2504bd49e4', None, None, None, None, None)] {{(pid=118108) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 18:48:37.052328 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-3a92e946-78f0-4e12-9bad-407f3b8b0c9c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Flavor limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 18:48:37.052752 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-3a92e946-78f0-4e12-9bad-407f3b8b0c9c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Image limits 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 18:48:37.053240 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-3a92e946-78f0-4e12-9bad-407f3b8b0c9c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Flavor pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 18:48:37.053676 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-3a92e946-78f0-4e12-9bad-407f3b8b0c9c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Image pref 0:0:0 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 18:48:37.054097 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.virt.hardware [None req-3a92e946-78f0-4e12-9bad-407f3b8b0c9c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118108) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 18:48:37.064034 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3a92e946-78f0-4e12-9bad-407f3b8b0c9c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:37.064463 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3a92e946-78f0-4e12-9bad-407f3b8b0c9c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:37.065295 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3a92e946-78f0-4e12-9bad-407f3b8b0c9c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:37.065849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-3a92e946-78f0-4e12-9bad-407f3b8b0c9c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:37.084566 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-3a92e946-78f0-4e12-9bad-407f3b8b0c9c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Getting quotas for project 88c0ee0e3bda4c9b98c295af8718eff6. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 18:48:37.089357 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.quota [None req-3a92e946-78f0-4e12-9bad-407f3b8b0c9c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Getting quotas for user 0628da68245a42e4af2e16e42babc15a and project 88c0ee0e3bda4c9b98c295af8718eff6. Resources: {'instances', 'ram', 'cores'} {{(pid=118108) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 18:48:37.150043 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-3a92e946-78f0-4e12-9bad-407f3b8b0c9c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Going to run 1 instances... {{(pid=118108) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 18:48:37.152192 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-3a92e946-78f0-4e12-9bad-407f3b8b0c9c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d69c301e-ee62-42ca-ab6b-2facbe714c31',volume_size=None,volume_type=None)] {{(pid=118108) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 18:48:37.296574 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-3a92e946-78f0-4e12-9bad-407f3b8b0c9c tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.928062 Jun 21 18:48:37.297223 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 574/1149] 10.222.0.87 () {60 vars in 1146 bytes} [Tue Jun 21 18:48:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 18:48:37.308445 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-b560e6fb-1f36-4a1e-9e15-cb4acd84265b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:37.309105 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-b560e6fb-1f36-4a1e-9e15-cb4acd84265b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:37.378198 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-b560e6fb-1f36-4a1e-9e15-cb4acd84265b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:37.388427 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-b560e6fb-1f36-4a1e-9e15-cb4acd84265b tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f" status: 200 len: 1094 microversion: 2.1 time: 0.084486 Jun 21 18:48:37.389190 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 576/1150] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:37 2022] GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:48:37.415968 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c443d70b-ee21-4d03-aa65-f957987528b0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:37.416939 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c443d70b-ee21-4d03-aa65-f957987528b0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [instance: 7c5acc09-82a3-4cb4-9c04-f582cf629c63] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:37.423831 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c443d70b-ee21-4d03-aa65-f957987528b0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:37.424175 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c443d70b-ee21-4d03-aa65-f957987528b0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:37.425387 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c443d70b-ee21-4d03-aa65-f957987528b0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:37.426052 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c443d70b-ee21-4d03-aa65-f957987528b0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:37.441405 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-c443d70b-ee21-4d03-aa65-f957987528b0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] HTTP exception thrown: Instance 7c5acc09-82a3-4cb4-9c04-f582cf629c63 could not be found. Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c443d70b-ee21-4d03-aa65-f957987528b0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Request method failure captured: Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 HTTP/1.1 Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABishEr6xNW_aNe0ZrEAB88uYCer0oR5ogXIhPY_dS0qTWm813r565-4tknVRuAOjIpjjOR_D2oBiNu7EzXZyTpdOPmPjlHku7eKK52jm-NdyaqJljelC3_1yBDb-8O8BtRFznbZ0iZmO57annULE-To32NlsaPG6qjmeh8aZ5WDWjtkHo Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 990014bc19574d66ae5faae5c0751d5c Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-TestShelveInstance-320358881 Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:48:37.443259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:48:37.450326 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/990014bc19574d66ae5faae5c0751d5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/990014bc19574d66ae5faae5c0751d5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/990014bc19574d66ae5faae5c0751d5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_990014bc19574d66ae5faae5c0751d5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:48:37.450326 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-TestShelveInstance-320358881 Jun 21 18:48:37.450326 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 990014bc19574d66ae5faae5c0751d5c Jun 21 18:48:37.450326 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-TestShelveInstance-320358881 Jun 21 18:48:37.450326 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-TestShelveInstance-320358881-project Jun 21 18:48:37.450326 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:48:37.450326 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:48:37.450326 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: ea95ad1fabb74ba692aa9172128035eb Jun 21 18:48:37.450326 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-TestShelveInstance-320358881-project Jun 21 18:48:37.450326 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:48:37.450326 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance 7c5acc09-82a3-4cb4-9c04-f582cf629c63 could not be found. Jun 21 18:48:37.450326 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': '7c5acc09-82a3-4cb4-9c04-f582cf629c63'} Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c5acc09-82a3-4cb4-9c04-f582cf629c63 could not be found. Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:48:37.452615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:48:37.454720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:48:37.454720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:48:37.454720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:48:37.454720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:48:37.454720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:48:37.454720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:48:37.454720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:48:37.454720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c5acc09-82a3-4cb4-9c04-f582cf629c63 could not be found. Jun 21 18:48:37.454720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:48:37.454720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:48:37.454720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:48:37.454720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:48:37.454720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:48:37.454720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:48:37.454720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:48:37.454720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:48:37.454720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c5acc09-82a3-4cb4-9c04-f582cf629c63 could not be found. Jun 21 18:48:37.454720 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:48:37.456854 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c443d70b-ee21-4d03-aa65-f957987528b0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Returning 404 to user: Instance 7c5acc09-82a3-4cb4-9c04-f582cf629c63 could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:48:37.456854 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c443d70b-ee21-4d03-aa65-f957987528b0 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63" status: 404 len: 111 microversion: 2.1 time: 0.033679 Jun 21 18:48:37.456854 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 575/1151] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:37 2022] GET /compute/v2.1/servers/7c5acc09-82a3-4cb4-9c04-f582cf629c63 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 18:48:37.668857 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-f30fc2b9-c94f-4c47-a110-184fdf6fc3d9 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] Calling method '.version_select at 0x7fd8b80c1310>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:37.674237 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f30fc2b9-c94f-4c47-a110-184fdf6fc3d9 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [f705dd1a-bf73-4bb7-aae9-0a25c3a8a05f] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 21 18:48:38.410936 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-43f59fcc-748d-4f1b-928d-59fac618cd6d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:38.412418 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-43f59fcc-748d-4f1b-928d-59fac618cd6d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:38.423489 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-43f59fcc-748d-4f1b-928d-59fac618cd6d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:38.425379 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-43f59fcc-748d-4f1b-928d-59fac618cd6d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:38.426906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-43f59fcc-748d-4f1b-928d-59fac618cd6d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:38.427799 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-43f59fcc-748d-4f1b-928d-59fac618cd6d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:38.548027 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-43f59fcc-748d-4f1b-928d-59fac618cd6d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:38.561603 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-43f59fcc-748d-4f1b-928d-59fac618cd6d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f" status: 200 len: 1210 microversion: 2.1 time: 0.156957 Jun 21 18:48:38.570350 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 576/1152] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:38 2022] GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f => generated 1210 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:48:38.683250 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO oslo.messaging._drivers.impl_rabbit [None req-f30fc2b9-c94f-4c47-a110-184fdf6fc3d9 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] [f705dd1a-bf73-4bb7-aae9-0a25c3a8a05f] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 49852. Jun 21 18:48:38.714005 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-f30fc2b9-c94f-4c47-a110-184fdf6fc3d9 tempest-TestShelveInstance-320358881 tempest-TestShelveInstance-320358881-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-947960101" status: 202 len: 0 microversion: 2.1 time: 1.049746 Jun 21 18:48:38.715033 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 577/1153] 10.222.0.87 () {58 vars in 1250 bytes} [Tue Jun 21 18:48:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-947960101 => generated 0 bytes in 1052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:48:39.592348 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-bfb7e46e-8bfc-415e-9c0f-2f2e0a897e4f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:39.593864 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-bfb7e46e-8bfc-415e-9c0f-2f2e0a897e4f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:39.602347 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bfb7e46e-8bfc-415e-9c0f-2f2e0a897e4f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:39.602803 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bfb7e46e-8bfc-415e-9c0f-2f2e0a897e4f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:39.603873 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bfb7e46e-8bfc-415e-9c0f-2f2e0a897e4f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:39.604299 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-bfb7e46e-8bfc-415e-9c0f-2f2e0a897e4f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:39.827229 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-bfb7e46e-8bfc-415e-9c0f-2f2e0a897e4f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:39.859565 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-bfb7e46e-8bfc-415e-9c0f-2f2e0a897e4f tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f" status: 200 len: 1265 microversion: 2.1 time: 0.248628 Jun 21 18:48:39.859565 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 577/1154] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:39 2022] GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:48:40.341950 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [req-c0cc80a9-ef8d-4fa8-9cd6-041319a08425 req-6e94c723-e64c-440d-8f48-6a69a1f3009f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ccaaff6-39d2-41c8-b94e-0141e17c610f", "tag": "d22b674a-2ba0-482d-8467-18d56ee05ec2"}]} {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:48:40.353532 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-c0cc80a9-ef8d-4fa8-9cd6-041319a08425 req-6e94c723-e64c-440d-8f48-6a69a1f3009f service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:40.354366 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [req-c0cc80a9-ef8d-4fa8-9cd6-041319a08425 req-6e94c723-e64c-440d-8f48-6a69a1f3009f service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:40.375670 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.compute.server_external_events [req-c0cc80a9-ef8d-4fa8-9cd6-041319a08425 req-6e94c723-e64c-440d-8f48-6a69a1f3009f service nova] Creating event network-changed:d22b674a-2ba0-482d-8467-18d56ee05ec2 for instance 5ccaaff6-39d2-41c8-b94e-0141e17c610f on hv-cinder-84460 Jun 21 18:48:40.387065 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [req-c0cc80a9-ef8d-4fa8-9cd6-041319a08425 req-6e94c723-e64c-440d-8f48-6a69a1f3009f service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049152 Jun 21 18:48:40.388368 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 578/1155] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:48:40.867679 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-470d4f7f-ec5a-4365-942e-170ed2cea97d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:40.869211 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-470d4f7f-ec5a-4365-942e-170ed2cea97d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:40.876584 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-470d4f7f-ec5a-4365-942e-170ed2cea97d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:40.877012 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-470d4f7f-ec5a-4365-942e-170ed2cea97d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:40.878160 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-470d4f7f-ec5a-4365-942e-170ed2cea97d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:40.878614 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-470d4f7f-ec5a-4365-942e-170ed2cea97d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:41.075253 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-470d4f7f-ec5a-4365-942e-170ed2cea97d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:41.087615 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-470d4f7f-ec5a-4365-942e-170ed2cea97d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f" status: 200 len: 1265 microversion: 2.1 time: 0.224395 Jun 21 18:48:41.097103 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 578/1156] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:40 2022] GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:48:42.116415 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-43f247f8-6fc8-478b-a9d5-a3866d7c69a5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:42.117751 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-43f247f8-6fc8-478b-a9d5-a3866d7c69a5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:42.133562 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-43f247f8-6fc8-478b-a9d5-a3866d7c69a5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:42.135000 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-43f247f8-6fc8-478b-a9d5-a3866d7c69a5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:42.136156 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-43f247f8-6fc8-478b-a9d5-a3866d7c69a5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:42.137452 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-43f247f8-6fc8-478b-a9d5-a3866d7c69a5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:42.564827 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-43f247f8-6fc8-478b-a9d5-a3866d7c69a5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:42.578398 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-43f247f8-6fc8-478b-a9d5-a3866d7c69a5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f" status: 200 len: 1265 microversion: 2.1 time: 0.476820 Jun 21 18:48:42.579320 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 579/1157] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:42 2022] GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f => generated 1265 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:48:43.600393 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-1672382f-9d55-4ed5-bda0-bd1cc4baf208 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:43.601534 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-1672382f-9d55-4ed5-bda0-bd1cc4baf208 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:43.611205 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1672382f-9d55-4ed5-bda0-bd1cc4baf208 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:43.611796 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1672382f-9d55-4ed5-bda0-bd1cc4baf208 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:43.613612 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1672382f-9d55-4ed5-bda0-bd1cc4baf208 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:43.614238 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-1672382f-9d55-4ed5-bda0-bd1cc4baf208 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:43.776301 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-1672382f-9d55-4ed5-bda0-bd1cc4baf208 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:43.784952 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-1672382f-9d55-4ed5-bda0-bd1cc4baf208 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f" status: 200 len: 1265 microversion: 2.1 time: 0.191484 Jun 21 18:48:43.785528 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 579/1158] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:43 2022] GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:48:44.805982 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-7725a578-5d65-40d0-98ee-7b06c7ff4366 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:44.807313 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-7725a578-5d65-40d0-98ee-7b06c7ff4366 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:44.819923 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7725a578-5d65-40d0-98ee-7b06c7ff4366 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:44.821936 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7725a578-5d65-40d0-98ee-7b06c7ff4366 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:44.822802 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7725a578-5d65-40d0-98ee-7b06c7ff4366 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:44.823882 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-7725a578-5d65-40d0-98ee-7b06c7ff4366 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:45.050918 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-7725a578-5d65-40d0-98ee-7b06c7ff4366 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:45.066353 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-7725a578-5d65-40d0-98ee-7b06c7ff4366 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f" status: 200 len: 1265 microversion: 2.1 time: 0.264302 Jun 21 18:48:45.069873 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 580/1159] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:44 2022] GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:48:46.095636 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-ef407e75-dd5a-4eab-ad82-383118074a17 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:46.096298 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-ef407e75-dd5a-4eab-ad82-383118074a17 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:46.103899 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef407e75-dd5a-4eab-ad82-383118074a17 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:46.104237 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef407e75-dd5a-4eab-ad82-383118074a17 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:46.105074 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef407e75-dd5a-4eab-ad82-383118074a17 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:46.105504 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-ef407e75-dd5a-4eab-ad82-383118074a17 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:46.336230 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-ef407e75-dd5a-4eab-ad82-383118074a17 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:46.348229 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-ef407e75-dd5a-4eab-ad82-383118074a17 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f" status: 200 len: 1265 microversion: 2.1 time: 0.257041 Jun 21 18:48:46.349613 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 580/1160] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:46 2022] GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:48:47.367209 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-ec914040-20dd-461d-8499-e3f462d854f3 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:47.368024 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-ec914040-20dd-461d-8499-e3f462d854f3 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:47.376343 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ec914040-20dd-461d-8499-e3f462d854f3 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:47.376808 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ec914040-20dd-461d-8499-e3f462d854f3 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:47.377582 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ec914040-20dd-461d-8499-e3f462d854f3 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:47.378047 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-ec914040-20dd-461d-8499-e3f462d854f3 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:47.383742 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell0:SELECT=2 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:48:47.531942 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-ec914040-20dd-461d-8499-e3f462d854f3 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:47.540513 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-ec914040-20dd-461d-8499-e3f462d854f3 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f" status: 200 len: 1265 microversion: 2.1 time: 0.178199 Jun 21 18:48:47.541100 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 581/1161] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:47 2022] GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:48:48.558761 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-16daa062-0400-4fe5-aca0-032a5b549342 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:48.559841 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-16daa062-0400-4fe5-aca0-032a5b549342 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:48.561984 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=2 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:48:48.562892 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell0:SELECT=6 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:48:48.571334 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-16daa062-0400-4fe5-aca0-032a5b549342 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:48.572085 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-16daa062-0400-4fe5-aca0-032a5b549342 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:48.573371 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-16daa062-0400-4fe5-aca0-032a5b549342 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:48.574119 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-16daa062-0400-4fe5-aca0-032a5b549342 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:48.796634 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-16daa062-0400-4fe5-aca0-032a5b549342 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:48.798292 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-16daa062-0400-4fe5-aca0-032a5b549342 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f" status: 200 len: 1265 microversion: 2.1 time: 0.243433 Jun 21 18:48:48.798902 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 581/1162] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:48 2022] GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:48:49.817880 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-e432f9c8-b3a7-4219-bad0-ec52ae714f6a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:49.818762 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-e432f9c8-b3a7-4219-bad0-ec52ae714f6a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:49.826805 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e432f9c8-b3a7-4219-bad0-ec52ae714f6a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:49.827419 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e432f9c8-b3a7-4219-bad0-ec52ae714f6a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:49.828225 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e432f9c8-b3a7-4219-bad0-ec52ae714f6a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:49.829221 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-e432f9c8-b3a7-4219-bad0-ec52ae714f6a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:49.986092 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-e432f9c8-b3a7-4219-bad0-ec52ae714f6a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:49.995106 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-e432f9c8-b3a7-4219-bad0-ec52ae714f6a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f" status: 200 len: 1265 microversion: 2.1 time: 0.182052 Jun 21 18:48:49.995918 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 582/1163] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:49 2022] GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:48:50.066510 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-394ac1ea-d138-4a1d-901c-1c091d0f9e0e req-86d2ba7b-67a6-400a-a2ef-f2ae01a9d1ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ccaaff6-39d2-41c8-b94e-0141e17c610f", "name": "network-vif-plugged", "status": "completed", "tag": "d22b674a-2ba0-482d-8467-18d56ee05ec2"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:48:50.077587 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-394ac1ea-d138-4a1d-901c-1c091d0f9e0e req-86d2ba7b-67a6-400a-a2ef-f2ae01a9d1ae service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:50.078338 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-394ac1ea-d138-4a1d-901c-1c091d0f9e0e req-86d2ba7b-67a6-400a-a2ef-f2ae01a9d1ae service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:50.094972 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-394ac1ea-d138-4a1d-901c-1c091d0f9e0e req-86d2ba7b-67a6-400a-a2ef-f2ae01a9d1ae service nova] Creating event network-vif-plugged:d22b674a-2ba0-482d-8467-18d56ee05ec2 for instance 5ccaaff6-39d2-41c8-b94e-0141e17c610f on hv-cinder-84460 Jun 21 18:48:50.101241 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-394ac1ea-d138-4a1d-901c-1c091d0f9e0e req-86d2ba7b-67a6-400a-a2ef-f2ae01a9d1ae service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039683 Jun 21 18:48:50.101890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 582/1164] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:48:51.014289 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-01d53561-7b28-4bb5-b46b-d8e3ea100126 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:51.015129 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-01d53561-7b28-4bb5-b46b-d8e3ea100126 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:51.023357 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-01d53561-7b28-4bb5-b46b-d8e3ea100126 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:51.024032 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-01d53561-7b28-4bb5-b46b-d8e3ea100126 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:51.024886 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-01d53561-7b28-4bb5-b46b-d8e3ea100126 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:51.025323 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-01d53561-7b28-4bb5-b46b-d8e3ea100126 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:51.209540 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-01d53561-7b28-4bb5-b46b-d8e3ea100126 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:51.217881 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-01d53561-7b28-4bb5-b46b-d8e3ea100126 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f" status: 200 len: 1265 microversion: 2.1 time: 0.208722 Jun 21 18:48:51.218596 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 583/1165] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:51 2022] GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:48:52.250425 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c5b6b3f9-ff36-4a27-b2f4-8ad67319daf6 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:52.251657 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c5b6b3f9-ff36-4a27-b2f4-8ad67319daf6 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:52.260554 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c5b6b3f9-ff36-4a27-b2f4-8ad67319daf6 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:52.261145 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c5b6b3f9-ff36-4a27-b2f4-8ad67319daf6 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:52.262142 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c5b6b3f9-ff36-4a27-b2f4-8ad67319daf6 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:52.262872 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c5b6b3f9-ff36-4a27-b2f4-8ad67319daf6 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:52.447501 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-c5b6b3f9-ff36-4a27-b2f4-8ad67319daf6 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:52.462782 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c5b6b3f9-ff36-4a27-b2f4-8ad67319daf6 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f" status: 200 len: 1451 microversion: 2.1 time: 0.220800 Jun 21 18:48:52.463794 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 583/1166] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:52 2022] GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f => generated 1451 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:48:52.480495 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-8221941a-efe1-4e1a-9ab9-78d4f68c3adb tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:48:52.481147 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-8221941a-efe1-4e1a-9ab9-78d4f68c3adb tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:48:52.488264 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8221941a-efe1-4e1a-9ab9-78d4f68c3adb tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:52.488678 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8221941a-efe1-4e1a-9ab9-78d4f68c3adb tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:52.489458 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8221941a-efe1-4e1a-9ab9-78d4f68c3adb tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:52.489918 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-8221941a-efe1-4e1a-9ab9-78d4f68c3adb tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:52.697491 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-8221941a-efe1-4e1a-9ab9-78d4f68c3adb tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:48:52.706219 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-8221941a-efe1-4e1a-9ab9-78d4f68c3adb tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f" status: 200 len: 1451 microversion: 2.1 time: 0.229203 Jun 21 18:48:52.706800 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 584/1167] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:48:52 2022] GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f => generated 1451 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:48:55.384536 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-cd4b7a4b-5764-484c-bc3a-b756f073d3e5 req-7ad13219-4941-402d-8fc3-72c31c708ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ccaaff6-39d2-41c8-b94e-0141e17c610f", "tag": "d22b674a-2ba0-482d-8467-18d56ee05ec2"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:48:55.394195 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-cd4b7a4b-5764-484c-bc3a-b756f073d3e5 req-7ad13219-4941-402d-8fc3-72c31c708ba5 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:48:55.394823 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-cd4b7a4b-5764-484c-bc3a-b756f073d3e5 req-7ad13219-4941-402d-8fc3-72c31c708ba5 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:48:55.408042 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-cd4b7a4b-5764-484c-bc3a-b756f073d3e5 req-7ad13219-4941-402d-8fc3-72c31c708ba5 service nova] Creating event network-changed:d22b674a-2ba0-482d-8467-18d56ee05ec2 for instance 5ccaaff6-39d2-41c8-b94e-0141e17c610f on hv-cinder-84460 Jun 21 18:48:55.414973 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-cd4b7a4b-5764-484c-bc3a-b756f073d3e5 req-7ad13219-4941-402d-8fc3-72c31c708ba5 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034003 Jun 21 18:48:55.415566 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 584/1168] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:49:46.982108 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:49:46.983117 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Tue Jun 21 18:49:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:50:59.563434 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9b61fab6-37f9-4eb1-9793-19daf13384f5] AMQP server on 10.222.0.87:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 21 18:50:59.564255 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:50:59.565672 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG dbcounter [-] [118109] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118109) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:50:59.566557 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR oslo.messaging._drivers.impl_rabbit [-] [719a3753-174b-4505-9cb1-2c9a58019358] AMQP server on 10.222.0.87:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 21 18:50:59.567180 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:50:59.568457 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG dbcounter [-] [118108] Writing DB stats nova_cell1:SELECT=76 {{(pid=118108) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 18:50:59.575263 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-94e8b3bd-d85f-4a72-9720-0d27be572ef1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:50:59.576249 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-94e8b3bd-d85f-4a72-9720-0d27be572ef1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:50:59.576626 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-a4611d2a-93e3-4a89-a253-b7cf4b671ce1 req-fd515796-1d46-46d7-8e18-a63cdb397240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ccaaff6-39d2-41c8-b94e-0141e17c610f", "tag": "d22b674a-2ba0-482d-8467-18d56ee05ec2"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:50:59.592352 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-94e8b3bd-d85f-4a72-9720-0d27be572ef1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:50:59.593091 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-94e8b3bd-d85f-4a72-9720-0d27be572ef1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:50:59.594665 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-94e8b3bd-d85f-4a72-9720-0d27be572ef1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:50:59.595865 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-94e8b3bd-d85f-4a72-9720-0d27be572ef1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:50:59.597707 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-a4611d2a-93e3-4a89-a253-b7cf4b671ce1 req-fd515796-1d46-46d7-8e18-a63cdb397240 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:50:59.598498 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-a4611d2a-93e3-4a89-a253-b7cf4b671ce1 req-fd515796-1d46-46d7-8e18-a63cdb397240 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:50:59.622616 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-a4611d2a-93e3-4a89-a253-b7cf4b671ce1 req-fd515796-1d46-46d7-8e18-a63cdb397240 service nova] Creating event network-changed:d22b674a-2ba0-482d-8467-18d56ee05ec2 for instance 5ccaaff6-39d2-41c8-b94e-0141e17c610f on hv-cinder-84460 Jun 21 18:50:59.632553 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-a4611d2a-93e3-4a89-a253-b7cf4b671ce1 req-fd515796-1d46-46d7-8e18-a63cdb397240 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068552 Jun 21 18:50:59.633699 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 585/1169] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:50:59.649958 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-94e8b3bd-d85f-4a72-9720-0d27be572ef1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Going to try to terminate instance {{(pid=118109) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:50:59.790472 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-94e8b3bd-d85f-4a72-9720-0d27be572ef1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "DELETE /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f" status: 204 len: 0 microversion: 2.1 time: 0.229662 Jun 21 18:50:59.794087 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 585/1170] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:50:59 2022] DELETE /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 18:50:59.804289 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-6a2c0856-eae7-48a5-be00-52c4313718c9 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:50:59.805281 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-6a2c0856-eae7-48a5-be00-52c4313718c9 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:50:59.819392 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6a2c0856-eae7-48a5-be00-52c4313718c9 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:50:59.819849 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6a2c0856-eae7-48a5-be00-52c4313718c9 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:50:59.820721 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6a2c0856-eae7-48a5-be00-52c4313718c9 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:50:59.821082 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-6a2c0856-eae7-48a5-be00-52c4313718c9 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:00.237221 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-6a2c0856-eae7-48a5-be00-52c4313718c9 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:51:00.245677 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-6a2c0856-eae7-48a5-be00-52c4313718c9 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f" status: 200 len: 1576 microversion: 2.1 time: 0.448772 Jun 21 18:51:00.246251 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 586/1171] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:50:59 2022] GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f => generated 1576 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 18:51:01.265079 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-c7ccbba7-3425-4c7e-bcff-0f8331b75eb7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:51:01.265687 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-c7ccbba7-3425-4c7e-bcff-0f8331b75eb7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:51:01.275104 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c7ccbba7-3425-4c7e-bcff-0f8331b75eb7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:01.275620 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c7ccbba7-3425-4c7e-bcff-0f8331b75eb7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:01.276510 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c7ccbba7-3425-4c7e-bcff-0f8331b75eb7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:01.276763 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-c7ccbba7-3425-4c7e-bcff-0f8331b75eb7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:01.283084 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO oslo.messaging._drivers.impl_rabbit [-] [9b61fab6-37f9-4eb1-9793-19daf13384f5] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 49984. Jun 21 18:51:01.549737 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-c7ccbba7-3425-4c7e-bcff-0f8331b75eb7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:51:01.559237 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-c7ccbba7-3425-4c7e-bcff-0f8331b75eb7 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f" status: 200 len: 1576 microversion: 2.1 time: 0.298491 Jun 21 18:51:01.559832 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 586/1172] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:51:01 2022] GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f => generated 1576 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:51:02.272949 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-a6699ef8-4a8b-4810-bae5-f1bfdb54e90d req-0020cbc7-3764-46a6-a828-f418cbbb18f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ccaaff6-39d2-41c8-b94e-0141e17c610f", "name": "network-vif-deleted", "tag": "d22b674a-2ba0-482d-8467-18d56ee05ec2"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:51:02.284654 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-a6699ef8-4a8b-4810-bae5-f1bfdb54e90d req-0020cbc7-3764-46a6-a828-f418cbbb18f7 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:02.285183 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-a6699ef8-4a8b-4810-bae5-f1bfdb54e90d req-0020cbc7-3764-46a6-a828-f418cbbb18f7 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:02.303229 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-a6699ef8-4a8b-4810-bae5-f1bfdb54e90d req-0020cbc7-3764-46a6-a828-f418cbbb18f7 service nova] Creating event network-vif-deleted:d22b674a-2ba0-482d-8467-18d56ee05ec2 for instance 5ccaaff6-39d2-41c8-b94e-0141e17c610f on hv-cinder-84460 Jun 21 18:51:02.308363 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO oslo.messaging._drivers.impl_rabbit [-] [719a3753-174b-4505-9cb1-2c9a58019358] Reconnected to AMQP server on 10.222.0.87:5672 via [amqp] client with port 49992. Jun 21 18:51:02.311014 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-a6699ef8-4a8b-4810-bae5-f1bfdb54e90d req-0020cbc7-3764-46a6-a828-f418cbbb18f7 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042323 Jun 21 18:51:02.311890 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 587/1173] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:51:02.581254 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-0850f6b3-31ca-40a9-aded-56115f5eb3ad tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:51:02.582636 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-0850f6b3-31ca-40a9-aded-56115f5eb3ad tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:51:02.594960 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0850f6b3-31ca-40a9-aded-56115f5eb3ad tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:02.596155 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0850f6b3-31ca-40a9-aded-56115f5eb3ad tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:02.596455 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0850f6b3-31ca-40a9-aded-56115f5eb3ad tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:02.597850 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-0850f6b3-31ca-40a9-aded-56115f5eb3ad tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:02.684864 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-0850f6b3-31ca-40a9-aded-56115f5eb3ad tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:51:02.697086 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-0850f6b3-31ca-40a9-aded-56115f5eb3ad tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f" status: 200 len: 1225 microversion: 2.1 time: 0.121104 Jun 21 18:51:02.710053 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 587/1174] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:51:02 2022] GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:51:03.728291 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-807465d7-5300-40df-be1d-43a72e616347 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:51:03.729145 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-807465d7-5300-40df-be1d-43a72e616347 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 5ccaaff6-39d2-41c8-b94e-0141e17c610f] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:51:03.737612 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-807465d7-5300-40df-be1d-43a72e616347 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:03.738080 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-807465d7-5300-40df-be1d-43a72e616347 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:03.738855 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-807465d7-5300-40df-be1d-43a72e616347 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:03.739278 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-807465d7-5300-40df-be1d-43a72e616347 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:03.753799 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-807465d7-5300-40df-be1d-43a72e616347 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] HTTP exception thrown: Instance 5ccaaff6-39d2-41c8-b94e-0141e17c610f could not be found. Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-807465d7-5300-40df-be1d-43a72e616347 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Request method failure captured: Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f HTTP/1.1 Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABishEe-MDGvAQhzWQKRSxv73kU_qtcPfKgh1r4ME4XIPHOi-6QWMmYt9-XxwyrbxZG3h4pEBr4xdx9vVUDwArTQEaBEEonZ9bfZeLaCBjust7KSIyOKLlbgDOXgs7s0sjz0SY1L-BqgbVFFsatNr3Wg7q-zW7dSWDL6yoe8c_1opK_3X4 Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 88c0ee0e3bda4c9b98c295af8718eff6 Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-TestVolumeBootPattern-477322311 Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:51:03.755509 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:51:03.758906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:51:03.758906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-TestVolumeBootPattern-477322311 Jun 21 18:51:03.758906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 88c0ee0e3bda4c9b98c295af8718eff6 Jun 21 18:51:03.758906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-TestVolumeBootPattern-477322311 Jun 21 18:51:03.758906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-TestVolumeBootPattern-477322311-project Jun 21 18:51:03.758906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:51:03.758906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:51:03.758906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 0628da68245a42e4af2e16e42babc15a Jun 21 18:51:03.758906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-TestVolumeBootPattern-477322311-project Jun 21 18:51:03.758906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:51:03.758906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance 5ccaaff6-39d2-41c8-b94e-0141e17c610f could not be found. Jun 21 18:51:03.758906 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': '5ccaaff6-39d2-41c8-b94e-0141e17c610f'} Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ccaaff6-39d2-41c8-b94e-0141e17c610f could not be found. Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:51:03.760706 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:51:03.763774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:51:03.763774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:51:03.763774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:51:03.763774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:51:03.763774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:51:03.763774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:51:03.763774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:51:03.763774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ccaaff6-39d2-41c8-b94e-0141e17c610f could not be found. Jun 21 18:51:03.763774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:51:03.763774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:51:03.763774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:51:03.763774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:51:03.763774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:51:03.763774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:51:03.763774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:51:03.763774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:51:03.763774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ccaaff6-39d2-41c8-b94e-0141e17c610f could not be found. Jun 21 18:51:03.763774 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:51:03.766687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-807465d7-5300-40df-be1d-43a72e616347 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Returning 404 to user: Instance 5ccaaff6-39d2-41c8-b94e-0141e17c610f could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:51:03.766687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-807465d7-5300-40df-be1d-43a72e616347 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f" status: 404 len: 111 microversion: 2.1 time: 0.036035 Jun 21 18:51:03.766687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 588/1175] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:51:03 2022] GET /compute/v2.1/servers/5ccaaff6-39d2-41c8-b94e-0141e17c610f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:51:07.245161 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a9d4d007-d596-413a-add8-e769ec66e1c1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:51:07.247525 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-a9d4d007-d596-413a-add8-e769ec66e1c1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:51:07.248818 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-3f6feb84-705c-45c1-87c3-083fbd30bc68 req-96a28b65-52dc-406e-bce3-16a3c646b6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "162493b0-54de-4244-b8a9-ec822fc97719", "tag": "31430c9b-bd60-4aca-80ff-3448ee48500b"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:51:07.262443 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a9d4d007-d596-413a-add8-e769ec66e1c1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:07.263177 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a9d4d007-d596-413a-add8-e769ec66e1c1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:07.264477 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a9d4d007-d596-413a-add8-e769ec66e1c1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:07.265183 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a9d4d007-d596-413a-add8-e769ec66e1c1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:07.265728 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-3f6feb84-705c-45c1-87c3-083fbd30bc68 req-96a28b65-52dc-406e-bce3-16a3c646b6b1 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:07.266980 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-3f6feb84-705c-45c1-87c3-083fbd30bc68 req-96a28b65-52dc-406e-bce3-16a3c646b6b1 service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:07.291268 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-3f6feb84-705c-45c1-87c3-083fbd30bc68 req-96a28b65-52dc-406e-bce3-16a3c646b6b1 service nova] Creating event network-changed:31430c9b-bd60-4aca-80ff-3448ee48500b for instance 162493b0-54de-4244-b8a9-ec822fc97719 on hv-cinder-84460 Jun 21 18:51:07.300239 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-3f6feb84-705c-45c1-87c3-083fbd30bc68 req-96a28b65-52dc-406e-bce3-16a3c646b6b1 service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057741 Jun 21 18:51:07.301227 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 589/1176] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 18:51:07.315403 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-a9d4d007-d596-413a-add8-e769ec66e1c1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Going to try to terminate instance {{(pid=118109) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 18:51:07.453799 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-a9d4d007-d596-413a-add8-e769ec66e1c1 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "DELETE /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 204 len: 0 microversion: 2.1 time: 0.216485 Jun 21 18:51:07.456097 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 588/1177] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:51:07 2022] DELETE /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 18:51:07.470858 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-eb459189-61d4-4c57-bf74-47efe601ce92 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:51:07.472155 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-eb459189-61d4-4c57-bf74-47efe601ce92 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:51:07.483279 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eb459189-61d4-4c57-bf74-47efe601ce92 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:07.484187 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eb459189-61d4-4c57-bf74-47efe601ce92 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:07.485592 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eb459189-61d4-4c57-bf74-47efe601ce92 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:07.486735 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-eb459189-61d4-4c57-bf74-47efe601ce92 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:07.706689 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.policy [None req-eb459189-61d4-4c57-bf74-47efe601ce92 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118108) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:51:07.715865 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-eb459189-61d4-4c57-bf74-47efe601ce92 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1576 microversion: 2.1 time: 0.254183 Jun 21 18:51:07.716653 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 590/1178] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:51:07 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1576 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:51:08.740794 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-93ae34d3-5bd0-4306-9a1e-12a257f0088a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:51:08.742069 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-93ae34d3-5bd0-4306-9a1e-12a257f0088a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:51:08.754998 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-93ae34d3-5bd0-4306-9a1e-12a257f0088a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:08.755469 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-93ae34d3-5bd0-4306-9a1e-12a257f0088a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:08.756835 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-93ae34d3-5bd0-4306-9a1e-12a257f0088a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:08.757579 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-93ae34d3-5bd0-4306-9a1e-12a257f0088a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:08.937348 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-93ae34d3-5bd0-4306-9a1e-12a257f0088a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:51:08.946650 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-93ae34d3-5bd0-4306-9a1e-12a257f0088a tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1576 microversion: 2.1 time: 0.213978 Jun 21 18:51:08.947678 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 589/1179] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:51:08 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1576 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:51:09.800893 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [req-4f9a9052-606a-44c6-a94f-5b50de6c6477 req-30076cdc-d5cd-46d2-a1ba-b6e7572fe35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "162493b0-54de-4244-b8a9-ec822fc97719", "name": "network-vif-deleted", "tag": "31430c9b-bd60-4aca-80ff-3448ee48500b"}]} {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 18:51:09.813851 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-4f9a9052-606a-44c6-a94f-5b50de6c6477 req-30076cdc-d5cd-46d2-a1ba-b6e7572fe35e service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:09.814388 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [req-4f9a9052-606a-44c6-a94f-5b50de6c6477 req-30076cdc-d5cd-46d2-a1ba-b6e7572fe35e service nova] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:09.833082 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.compute.server_external_events [req-4f9a9052-606a-44c6-a94f-5b50de6c6477 req-30076cdc-d5cd-46d2-a1ba-b6e7572fe35e service nova] Creating event network-vif-deleted:31430c9b-bd60-4aca-80ff-3448ee48500b for instance 162493b0-54de-4244-b8a9-ec822fc97719 on hv-cinder-84460 Jun 21 18:51:09.844814 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [req-4f9a9052-606a-44c6-a94f-5b50de6c6477 req-30076cdc-d5cd-46d2-a1ba-b6e7572fe35e service nova] 10.222.0.87 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048023 Jun 21 18:51:09.844814 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 591/1180] 10.222.0.87 () {64 vars in 1317 bytes} [Tue Jun 21 18:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 18:51:09.965816 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-532268fa-9fc4-41e2-82d9-825d6b3a54a5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:51:09.966763 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-532268fa-9fc4-41e2-82d9-825d6b3a54a5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:51:09.975090 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-532268fa-9fc4-41e2-82d9-825d6b3a54a5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:09.975592 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-532268fa-9fc4-41e2-82d9-825d6b3a54a5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:09.976505 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-532268fa-9fc4-41e2-82d9-825d6b3a54a5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:09.976998 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-532268fa-9fc4-41e2-82d9-825d6b3a54a5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:10.055238 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.policy [None req-532268fa-9fc4-41e2-82d9-825d6b3a54a5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0628da68245a42e4af2e16e42babc15a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c0ee0e3bda4c9b98c295af8718eff6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118109) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 18:51:10.069310 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-532268fa-9fc4-41e2-82d9-825d6b3a54a5 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 200 len: 1225 microversion: 2.1 time: 0.107431 Jun 21 18:51:10.077996 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 590/1181] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:51:09 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 18:51:11.089839 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c03a8efc-9305-4139-8303-159eedb71f31 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:51:11.090471 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-c03a8efc-9305-4139-8303-159eedb71f31 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: 162493b0-54de-4244-b8a9-ec822fc97719] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:51:11.098955 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c03a8efc-9305-4139-8303-159eedb71f31 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:11.099450 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c03a8efc-9305-4139-8303-159eedb71f31 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:11.100717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c03a8efc-9305-4139-8303-159eedb71f31 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:11.101463 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-c03a8efc-9305-4139-8303-159eedb71f31 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:11.125522 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-c03a8efc-9305-4139-8303-159eedb71f31 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] HTTP exception thrown: Instance 162493b0-54de-4244-b8a9-ec822fc97719 could not be found. Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c03a8efc-9305-4139-8303-159eedb71f31 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Request method failure captured: Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 HTTP/1.1 Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABishEe-MDGvAQhzWQKRSxv73kU_qtcPfKgh1r4ME4XIPHOi-6QWMmYt9-XxwyrbxZG3h4pEBr4xdx9vVUDwArTQEaBEEonZ9bfZeLaCBjust7KSIyOKLlbgDOXgs7s0sjz0SY1L-BqgbVFFsatNr3Wg7q-zW7dSWDL6yoe8c_1opK_3X4 Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 88c0ee0e3bda4c9b98c295af8718eff6 Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-TestVolumeBootPattern-477322311 Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:51:11.127611 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:51:11.132860 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:51:11.132860 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-TestVolumeBootPattern-477322311 Jun 21 18:51:11.132860 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 88c0ee0e3bda4c9b98c295af8718eff6 Jun 21 18:51:11.132860 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-TestVolumeBootPattern-477322311 Jun 21 18:51:11.132860 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-TestVolumeBootPattern-477322311-project Jun 21 18:51:11.132860 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:51:11.132860 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:51:11.132860 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 0628da68245a42e4af2e16e42babc15a Jun 21 18:51:11.132860 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-TestVolumeBootPattern-477322311-project Jun 21 18:51:11.132860 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:51:11.132860 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance 162493b0-54de-4244-b8a9-ec822fc97719 could not be found. Jun 21 18:51:11.132860 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': '162493b0-54de-4244-b8a9-ec822fc97719'} Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 162493b0-54de-4244-b8a9-ec822fc97719 could not be found. Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:51:11.134756 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:51:11.138247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:51:11.138247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:51:11.138247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:51:11.138247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:51:11.138247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:51:11.138247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:51:11.138247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:51:11.138247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 162493b0-54de-4244-b8a9-ec822fc97719 could not be found. Jun 21 18:51:11.138247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:51:11.138247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:51:11.138247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:51:11.138247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:51:11.138247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:51:11.138247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:51:11.138247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:51:11.138247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:51:11.138247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 162493b0-54de-4244-b8a9-ec822fc97719 could not be found. Jun 21 18:51:11.138247 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:51:11.139749 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-c03a8efc-9305-4139-8303-159eedb71f31 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Returning 404 to user: Instance 162493b0-54de-4244-b8a9-ec822fc97719 could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:51:11.139749 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-c03a8efc-9305-4139-8303-159eedb71f31 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719" status: 404 len: 111 microversion: 2.1 time: 0.045123 Jun 21 18:51:11.139749 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 592/1182] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:51:11 2022] GET /compute/v2.1/servers/162493b0-54de-4244-b8a9-ec822fc97719 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:51:11.663269 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a4c1cac3-8927-4b43-ac28-f34ab2a451bc tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:51:11.663938 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.compute.api [None req-a4c1cac3-8927-4b43-ac28-f34ab2a451bc tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118109) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:51:11.671461 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a4c1cac3-8927-4b43-ac28-f34ab2a451bc tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:11.672316 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a4c1cac3-8927-4b43-ac28-f34ab2a451bc tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:11.673823 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a4c1cac3-8927-4b43-ac28-f34ab2a451bc tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:11.674595 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG oslo_concurrency.lockutils [None req-a4c1cac3-8927-4b43-ac28-f34ab2a451bc tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118109) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:11.696085 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.wsgi [None req-a4c1cac3-8927-4b43-ac28-f34ab2a451bc tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] HTTP exception thrown: Instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 could not be found. Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a4c1cac3-8927-4b43-ac28-f34ab2a451bc tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Request method failure captured: Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: request: DELETE /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 HTTP/1.1 Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept: application/json Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Accept-Encoding: identity Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Connection: close Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Length: 0 Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Content-Type: application/json Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Host: 10.222.0.87 Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Openstack-System-Scope: None Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: User-Agent: python-urllib3/1.26.9 Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Auth-Token: gAAAAABishEe-MDGvAQhzWQKRSxv73kU_qtcPfKgh1r4ME4XIPHOi-6QWMmYt9-XxwyrbxZG3h4pEBr4xdx9vVUDwArTQEaBEEonZ9bfZeLaCBjust7KSIyOKLlbgDOXgs7s0sjz0SY1L-BqgbVFFsatNr3Wg7q-zW7dSWDL6yoe8c_1opK_3X4 Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Id: None Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Domain-Name: None Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Identity-Status: Confirmed Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Is-Admin-Project: True Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Id: default Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Domain-Name: Default Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Id: 88c0ee0e3bda4c9b98c295af8718eff6 Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Project-Name: tempest-TestVolumeBootPattern-477322311 Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Role: reader,member Jun 21 18:51:11.697908 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Roles: reader,member Jun 21 18:51:11.700433 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:51:11.700433 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant: tempest-TestVolumeBootPattern-477322311 Jun 21 18:51:11.700433 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Id: 88c0ee0e3bda4c9b98c295af8718eff6 Jun 21 18:51:11.700433 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-Tenant-Name: tempest-TestVolumeBootPattern-477322311 Jun 21 18:51:11.700433 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User: tempest-TestVolumeBootPattern-477322311-project Jun 21 18:51:11.700433 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Id: default Jun 21 18:51:11.700433 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Domain-Name: Default Jun 21 18:51:11.700433 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Id: 0628da68245a42e4af2e16e42babc15a Jun 21 18:51:11.700433 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: X-User-Name: tempest-TestVolumeBootPattern-477322311-project Jun 21 18:51:11.700433 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: method: > Jun 21 18:51:11.700433 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: exception: Instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 could not be found. Jun 21 18:51:11.700433 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: action_args: {'id': 'd7d8e4d2-7b70-415b-a82b-e217d55cef26'} Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 could not be found. Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:51:11.701420 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 could not be found. Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 could not be found. Jun 21 18:51:11.705109 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: ERROR nova.api.openstack.wsgi Jun 21 18:51:11.707921 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-a4c1cac3-8927-4b43-ac28-f34ab2a451bc tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Returning 404 to user: Instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 could not be found. {{(pid=118109) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:51:11.707921 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-a4c1cac3-8927-4b43-ac28-f34ab2a451bc tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "DELETE /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 404 len: 111 microversion: 2.1 time: 0.040701 Jun 21 18:51:11.707921 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 591/1183] 10.222.0.87 () {58 vars in 1238 bytes} [Tue Jun 21 18:51:11 2022] DELETE /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:51:11.712175 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-20836ea9-d2f5-4dc0-9b78-d33a40295745 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '>' {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:51:11.713245 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.compute.api [None req-20836ea9-d2f5-4dc0-9b78-d33a40295745 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] [instance: d7d8e4d2-7b70-415b-a82b-e217d55cef26] Fetching instance by UUID {{(pid=118108) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 18:51:11.724993 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-20836ea9-d2f5-4dc0-9b78-d33a40295745 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:11.725809 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-20836ea9-d2f5-4dc0-9b78-d33a40295745 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:11.727259 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-20836ea9-d2f5-4dc0-9b78-d33a40295745 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 18:51:11.728030 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG oslo_concurrency.lockutils [None req-20836ea9-d2f5-4dc0-9b78-d33a40295745 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Lock "1ae3aa00-a91e-47d9-9392-29a47002ac79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118108) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 18:51:11.748067 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.wsgi [None req-20836ea9-d2f5-4dc0-9b78-d33a40295745 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] HTTP exception thrown: Instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 could not be found. Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-20836ea9-d2f5-4dc0-9b78-d33a40295745 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Request method failure captured: Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: request: GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 HTTP/1.1 Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept: application/json Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Accept-Encoding: identity Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Connection: close Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Length: 0 Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Content-Type: application/json Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Host: 10.222.0.87 Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Openstack-System-Scope: None Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: User-Agent: python-urllib3/1.26.9 Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Auth-Token: gAAAAABishEe-MDGvAQhzWQKRSxv73kU_qtcPfKgh1r4ME4XIPHOi-6QWMmYt9-XxwyrbxZG3h4pEBr4xdx9vVUDwArTQEaBEEonZ9bfZeLaCBjust7KSIyOKLlbgDOXgs7s0sjz0SY1L-BqgbVFFsatNr3Wg7q-zW7dSWDL6yoe8c_1opK_3X4 Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Id: None Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Domain-Name: None Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Identity-Status: Confirmed Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Is-Admin-Project: True Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Id: default Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Domain-Name: Default Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Id: 88c0ee0e3bda4c9b98c295af8718eff6 Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Project-Name: tempest-TestVolumeBootPattern-477322311 Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Role: reader,member Jun 21 18:51:11.749687 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Roles: reader,member Jun 21 18:51:11.752470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2/88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/volume/v3/88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.87:8080", "publicURL": "http://10.222.0.87:8080/v1/AUTH_88c0ee0e3bda4c9b98c295af8718eff6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.87/image"}]}] Jun 21 18:51:11.752470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant: tempest-TestVolumeBootPattern-477322311 Jun 21 18:51:11.752470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Id: 88c0ee0e3bda4c9b98c295af8718eff6 Jun 21 18:51:11.752470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-Tenant-Name: tempest-TestVolumeBootPattern-477322311 Jun 21 18:51:11.752470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User: tempest-TestVolumeBootPattern-477322311-project Jun 21 18:51:11.752470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Id: default Jun 21 18:51:11.752470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Domain-Name: Default Jun 21 18:51:11.752470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Id: 0628da68245a42e4af2e16e42babc15a Jun 21 18:51:11.752470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: X-User-Name: tempest-TestVolumeBootPattern-477322311-project Jun 21 18:51:11.752470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: method: > Jun 21 18:51:11.752470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: exception: Instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 could not be found. Jun 21 18:51:11.752470 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: action_args: {'id': 'd7d8e4d2-7b70-415b-a82b-e217d55cef26'} Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: {{(pid=118108) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 could not be found. Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 18:51:11.753366 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 18:51:11.755385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 18:51:11.755385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 18:51:11.755385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 18:51:11.755385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 18:51:11.755385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 18:51:11.755385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 18:51:11.755385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 18:51:11.755385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 could not be found. Jun 21 18:51:11.755385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:51:11.755385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 18:51:11.755385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:51:11.755385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 18:51:11.755385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 18:51:11.755385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 18:51:11.755385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 18:51:11.755385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 18:51:11.755385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 could not be found. Jun 21 18:51:11.755385 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: ERROR nova.api.openstack.wsgi Jun 21 18:51:11.760079 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: DEBUG nova.api.openstack.wsgi [None req-20836ea9-d2f5-4dc0-9b78-d33a40295745 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Returning 404 to user: Instance d7d8e4d2-7b70-415b-a82b-e217d55cef26 could not be found. {{(pid=118108) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 18:51:11.760079 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO nova.api.openstack.requestlog [None req-20836ea9-d2f5-4dc0-9b78-d33a40295745 tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26" status: 404 len: 111 microversion: 2.1 time: 0.045555 Jun 21 18:51:11.760079 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: [pid: 118108|app: 0|req: 593/1184] 10.222.0.87 () {58 vars in 1235 bytes} [Tue Jun 21 18:51:11 2022] GET /compute/v2.1/servers/d7d8e4d2-7b70-415b-a82b-e217d55cef26 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 18:51:13.151037 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: DEBUG nova.api.openstack.wsgi [None req-d261a8e1-0019-45cb-9be8-f5698467314d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] Calling method '.version_select at 0x7fd8b2fb2af0>' {{(pid=118109) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 18:51:13.179722 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO nova.api.openstack.requestlog [None req-d261a8e1-0019-45cb-9be8-f5698467314d tempest-TestVolumeBootPattern-477322311 tempest-TestVolumeBootPattern-477322311-project] 10.222.0.87 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-198007524" status: 202 len: 0 microversion: 2.1 time: 0.032557 Jun 21 18:51:13.188325 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: [pid: 118109|app: 0|req: 592/1185] 10.222.0.87 () {58 vars in 1259 bytes} [Tue Jun 21 18:51:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-198007524 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 18:51:16.105044 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:51:16.105815 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Tue Jun 21 18:51:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:53:06.994829 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:53:06.995688 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Tue Jun 21 18:53:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:53:39.564159 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:53:39.565113 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Tue Jun 21 18:53:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:53:40.278002 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:53:40.278940 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Tue Jun 21 18:53:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:54:25.756024 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:54:25.756717 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Tue Jun 21 18:54:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:54:36.121774 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:54:36.121774 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Tue Jun 21 18:54:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:56:27.006224 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:56:27.006950 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Tue Jun 21 18:56:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:56:27.356529 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:56:27.357201 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Tue Jun 21 18:56:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:56:59.574719 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:56:59.574719 dv-cinder-844601-4-iscsi devstack@n-api.service[118108]: Tue Jun 21 18:56:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 18:57:00.289511 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 18:57:00.290231 dv-cinder-844601-4-iscsi devstack@n-api.service[118109]: Tue Jun 21 18:57:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!